Class cascading.FieldedPipesPlatformTest

29

tests

0

failures

22m6.10s

duration

100%

successful

Tests

Test Duration Result
testChainEndingWithEach 45.304s passed
testChainedTaps 1m39.86s passed
testConcatenation 32.131s passed
testCopy 24.297s passed
testFilter 24.093s passed
testFilterAll 1m12.91s passed
testFilterComplex 1m20.54s passed
testGeneratorAggregator 48.275s passed
testGroupByInsensitive 33.655s passed
testGroupGroup 1m8.83s passed
testLogicFilter 21.135s passed
testNoGroup 27.172s passed
testNone 32.850s passed
testReplace 21.111s passed
testSameSourceMergeThreeChainGroup 1m6.74s passed
testSimpleChain 50.052s passed
testSimpleGroup 42.213s passed
testSimpleMerge 36.329s passed
testSimpleMergeThree 45.335s passed
testSplit 27.030s passed
testSplitComplex 1m0.90s passed
testSplitNonSafe 1m5.08s passed
testSplitOut 1m21.19s passed
testSplitSameSourceMerged 57.127s passed
testSplitSameSourceMergedSameName 54.108s passed
testSwap 33.124s passed
testUnGroup 24.075s passed
testUnGroupAnon 26.562s passed
testUnGroupBySize 24.078s passed

Standard output

2013-10-31 18:25:53,092 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2013-10-31 18:25:53,111 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2013-10-31 18:25:53,111 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.FieldedPipesPlatformTest
2013-10-31 18:25:53,137 INFO  hadoop.HadoopPlatform (HadoopPlatform.java:setUp(118)) - using cluster
2013-10-31 18:25:53,381 INFO  util.GSet (BlocksMap.java:computeCapacity(338)) - VM type       = 64-bit
2013-10-31 18:25:53,382 INFO  util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 18:25:53,382 INFO  util.GSet (BlocksMap.java:computeCapacity(340)) - capacity      = 2^21 = 2097152 entries
2013-10-31 18:25:53,382 INFO  util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 18:25:53,558 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 18:25:53,558 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 18:25:53,558 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 18:25:53,561 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 18:25:53,561 WARN  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 18:25:53,562 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 18:25:53,567 INFO  namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times 
2013-10-31 18:25:53,706 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:54,908 INFO  common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name1 has been successfully formatted.
2013-10-31 18:25:54,911 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:54,999 INFO  common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name2 has been successfully formatted.
2013-10-31 18:25:55,044 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-namenode.properties, hadoop-metrics2.properties
2013-10-31 18:25:55,112 INFO  util.GSet (BlocksMap.java:computeCapacity(338)) - VM type       = 64-bit
2013-10-31 18:25:55,112 INFO  util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 18:25:55,112 INFO  util.GSet (BlocksMap.java:computeCapacity(340)) - capacity      = 2^21 = 2097152 entries
2013-10-31 18:25:55,112 INFO  util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 18:25:55,116 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 18:25:55,116 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 18:25:55,117 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 18:25:55,117 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 18:25:55,117 WARN  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 18:25:55,117 INFO  namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 18:25:55,120 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(5306)) - Registered FSNamesystemStateMBean and NameNodeMXBean
2013-10-31 18:25:55,120 INFO  namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times 
2013-10-31 18:25:55,124 INFO  common.Storage (FSImage.java:loadFSImage(899)) - Number of files = 1
2013-10-31 18:25:55,125 INFO  common.Storage (FSImage.java:loadFilesUnderConstruction(1435)) - Number of files under construction = 0
2013-10-31 18:25:55,125 INFO  common.Storage (FSImage.java:loadFSImage(832)) - Image file of size 112 loaded in 0 seconds.
2013-10-31 18:25:55,125 INFO  common.Storage (FSEditLog.java:loadFSEdits(901)) - Edits file build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0 seconds.
2013-10-31 18:25:55,126 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:55,206 INFO  common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:55,284 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2013-10-31 18:25:55,285 INFO  namenode.FSNamesystem (FSNamesystem.java:initialize(397)) - Finished loading FSImage in 169 msecs
2013-10-31 18:25:55,305 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3816)) - Total number of blocks = 0
2013-10-31 18:25:55,305 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3817)) - Number of invalid blocks = 0
2013-10-31 18:25:55,306 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3818)) - Number of under-replicated blocks = 0
2013-10-31 18:25:55,307 INFO  namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3819)) - Number of  over-replicated blocks = 0
2013-10-31 18:25:55,307 INFO  hdfs.StateChange (FSNamesystem.java:leave(4783)) - STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 19 msec
2013-10-31 18:25:55,308 INFO  hdfs.StateChange (FSNamesystem.java:leave(4789)) - STATE* Leaving safe mode after 0 secs.
2013-10-31 18:25:55,309 INFO  hdfs.StateChange (FSNamesystem.java:leave(4798)) - STATE* Network topology has 0 racks and 0 datanodes
2013-10-31 18:25:55,309 INFO  hdfs.StateChange (FSNamesystem.java:leave(4801)) - STATE* UnderReplicatedBlocks has 0 blocks
2013-10-31 18:25:55,315 INFO  util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 18:25:55,315 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 18:25:55,316 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 18:25:55,316 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 18:25:55,316 INFO  namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 18:25:55,325 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:25:55,328 INFO  namenode.NameNode (NameNode.java:initialize(301)) - Namenode up at: /127.0.0.1:34237
2013-10-31 18:25:55,365 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-10-31 18:25:55,414 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:25:55,423 INFO  http.HttpServer (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:25:55,428 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:25:55,429 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 44117 webServer.getConnectors()[0].getLocalPort() returned 44117
2013-10-31 18:25:55,430 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 44117
2013-10-31 18:25:55,430 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:25:55,465 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/hdfs to /tmp/Jetty_localhost_44117_hdfs____nz2ce9/webapp
2013-10-31 18:25:55,810 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:44117
2013-10-31 18:25:55,811 INFO  namenode.NameNode (NameNode.java:run(451)) - Web-server up at: localhost:44117
2013-10-31 18:25:55,811 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:25:55,811 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 34237: starting
2013-10-31 18:25:55,844 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 34237: starting
2013-10-31 18:25:55,844 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 34237: starting
2013-10-31 18:25:55,844 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 34237: starting
2013-10-31 18:25:55,845 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 34237: starting
2013-10-31 18:25:55,844 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 34237: starting
2013-10-31 18:25:55,844 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 34237: starting
2013-10-31 18:25:55,844 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 34237: starting
2013-10-31 18:25:55,845 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 34237: starting
2013-10-31 18:25:55,845 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 34237: starting
2013-10-31 18:25:55,845 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 34237: starting
2013-10-31 18:25:55,995 INFO  metrics.MetricsSaver (?:<init>(?)) - MetricsSaver GradleWorkerMain root:hdfs:///mnt/var/lib/hadoop/metrics/ period:60 instanceId:i-3e21d259 jobflow:j-3AAKWCJW7N40B
Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
2013-10-31 18:25:56,033 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:25:56,034 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:25:56,073 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data1 is not formatted.
2013-10-31 18:25:56,073 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:02,550 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data2 is not formatted.
2013-10-31 18:26:02,551 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:02,702 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:02,712 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 34578
2013-10-31 18:26:02,713 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:02,717 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:02,718 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:02,719 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:02,719 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 35620 webServer.getConnectors()[0].getLocalPort() returned 35620
2013-10-31 18:26:02,719 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 35620
2013-10-31 18:26:02,719 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:02,725 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_35620_datanode____adqtyx/webapp
2013-10-31 18:26:02,905 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:35620
2013-10-31 18:26:02,909 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:02,910 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:34578, storageID=, infoPort=35620, ipcPort=60357)
2013-10-31 18:26:02,924 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:34578 storage DS-11064708-10.5.128.102-34578-1383243962924
2013-10-31 18:26:02,927 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:34578
2013-10-31 18:26:03,009 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-11064708-10.5.128.102-34578-1383243962924 is assigned to data-node 127.0.0.1:34578
2013-10-31 18:26:03,010 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:03,013 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:34578 0 blocks
2013-10-31 18:26:03,014 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:26:03,015 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:26:03,015 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data1/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data2/current'}
Starting DataNode 1 with dfs.data.dir: build/test/data/dfs/data/data3,build/test/data/dfs/data/data4
2013-10-31 18:26:03,017 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:03,019 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 60357: starting
2013-10-31 18:26:03,020 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 60357: starting
2013-10-31 18:26:03,020 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 60357: starting
2013-10-31 18:26:03,021 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:03,022 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 60357: starting
2013-10-31 18:26:03,023 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:26:03,024 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:03,025 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:03,032 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:34578, blocks: 0, processing time: 2 msecs
2013-10-31 18:26:03,033 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 5 msec to generate and 4 msecs for RPC and NN processing
2013-10-31 18:26:03,033 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:03,034 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:03,035 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:03,062 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data3 is not formatted.
2013-10-31 18:26:03,063 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:03,204 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data4 is not formatted.
2013-10-31 18:26:03,204 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:03,346 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:03,347 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:03,352 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 54365
2013-10-31 18:26:03,352 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:03,355 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:03,357 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:03,357 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:03,358 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 44582 webServer.getConnectors()[0].getLocalPort() returned 44582
2013-10-31 18:26:03,358 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 44582
2013-10-31 18:26:03,359 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:03,371 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_44582_datanode____rfmx1y/webapp
2013-10-31 18:26:03,558 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:44582
2013-10-31 18:26:03,561 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:03,561 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:54365, storageID=, infoPort=44582, ipcPort=48188)
2013-10-31 18:26:03,562 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:54365 storage DS-316833290-10.5.128.102-54365-1383243963561
2013-10-31 18:26:03,562 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:54365
2013-10-31 18:26:04,886 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-316833290-10.5.128.102-54365-1383243963561 is assigned to data-node 127.0.0.1:54365
2013-10-31 18:26:04,887 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:04,889 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:54365 0 blocks
2013-10-31 18:26:04,891 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 2 with dfs.data.dir: build/test/data/dfs/data/data5,build/test/data/dfs/data/data6
2013-10-31 18:26:04,891 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data3/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data4/current'}
2013-10-31 18:26:04,892 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:26:04,897 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:04,897 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 48188: starting
2013-10-31 18:26:04,899 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 48188: starting
2013-10-31 18:26:04,898 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:04,898 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 48188: starting
2013-10-31 18:26:04,897 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 48188: starting
2013-10-31 18:26:04,899 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:26:04,903 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:04,905 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:04,910 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:54365, blocks: 0, processing time: 0 msecs
2013-10-31 18:26:04,911 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 5 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 18:26:04,912 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:04,913 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:04,913 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:04,946 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data5 is not formatted.
2013-10-31 18:26:04,946 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,195 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data6 is not formatted.
2013-10-31 18:26:05,196 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,337 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:05,338 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:05,340 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 59471
2013-10-31 18:26:05,340 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:05,342 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:05,343 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:05,343 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:05,343 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 57157 webServer.getConnectors()[0].getLocalPort() returned 57157
2013-10-31 18:26:05,343 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 57157
2013-10-31 18:26:05,344 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:05,350 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_57157_datanode____.3e2bqg/webapp
2013-10-31 18:26:05,556 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:57157
2013-10-31 18:26:05,559 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:05,559 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:59471, storageID=, infoPort=57157, ipcPort=33809)
2013-10-31 18:26:05,560 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:59471 storage DS-955759156-10.5.128.102-59471-1383243965559
2013-10-31 18:26:05,561 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:59471
2013-10-31 18:26:05,602 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-955759156-10.5.128.102-59471-1383243965559 is assigned to data-node 127.0.0.1:59471
2013-10-31 18:26:05,602 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:05,604 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:59471 0 blocks
2013-10-31 18:26:05,605 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:26:05,606 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
Starting DataNode 3 with dfs.data.dir: build/test/data/dfs/data/data7,build/test/data/dfs/data/data8
2013-10-31 18:26:05,606 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data5/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data6/current'}
2013-10-31 18:26:05,610 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:05,610 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 33809: starting
2013-10-31 18:26:05,610 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:05,611 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 33809: starting
2013-10-31 18:26:05,610 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 33809: starting
2013-10-31 18:26:05,610 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 33809: starting
2013-10-31 18:26:05,610 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:26:05,614 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:05,614 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:05,614 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:59471, blocks: 0, processing time: 0 msecs
2013-10-31 18:26:05,616 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 1 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 18:26:05,616 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:05,621 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:05,622 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:05,636 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data7 is not formatted.
2013-10-31 18:26:05,636 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,741 INFO  common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data8 is not formatted.
2013-10-31 18:26:05,741 INFO  common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,844 INFO  datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:05,845 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
	at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:05,850 INFO  datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 37740
2013-10-31 18:26:05,850 INFO  datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:05,853 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:05,855 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:05,855 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:05,856 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 55697 webServer.getConnectors()[0].getLocalPort() returned 55697
2013-10-31 18:26:05,856 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 55697
2013-10-31 18:26:05,856 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:05,870 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_55697_datanode____xojhnf/webapp
2013-10-31 18:26:06,033 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:55697
2013-10-31 18:26:06,036 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:06,036 INFO  datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:37740, storageID=, infoPort=55697, ipcPort=35555)
2013-10-31 18:26:06,038 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:37740 storage DS-1799801127-10.5.128.102-37740-1383243966037
2013-10-31 18:26:06,039 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:37740
2013-10-31 18:26:06,087 INFO  datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1799801127-10.5.128.102-37740-1383243966037 is assigned to data-node 127.0.0.1:37740
2013-10-31 18:26:06,087 INFO  datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:06,089 INFO  hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:37740 0 blocks
2013-10-31 18:26:06,090 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:26:06,091 INFO  datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data7/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data8/current'}
2013-10-31 18:26:06,091 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:26:06,094 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:06,095 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 35555: starting
2013-10-31 18:26:06,097 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 35555: starting
2013-10-31 18:26:06,097 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 35555: starting
2013-10-31 18:26:06,097 INFO  datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:06,094 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 35555: starting
2013-10-31 18:26:06,103 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:06,156 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:26:06,176 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:37740, blocks: 0, processing time: 0 msecs
2013-10-31 18:26:06,178 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 2 msec to generate and 73 msecs for RPC and NN processing
2013-10-31 18:26:06,178 INFO  datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:06,180 INFO  datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:06,180 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
Generating rack names for tasktrackers
Generating host names for tasktrackers
2013-10-31 18:26:06,228 WARN  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties, hadoop-metrics2.properties
2013-10-31 18:26:06,228 WARN  util.MBeans (MBeans.java:register(59)) - Hadoop:service=JobTracker,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
	at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
	at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
	at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
	at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
	at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:285)
	at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
	at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:112)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
	at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:06,257 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 18:26:06,259 INFO  mapred.JobTracker (JobTracker.java:initializeTaskMemoryRelatedConfig(5174)) - Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-10-31 18:26:06,259 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(377)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-10-31 18:26:06,259 INFO  util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 18:26:06,260 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 18:26:06,261 INFO  mapred.JobTracker (JobTracker.java:<init>(2279)) - Starting jobtracker with owner as hadoop
2013-10-31 18:26:06,265 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:06,266 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:06,283 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:06,283 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 49233 webServer.getConnectors()[0].getLocalPort() returned 49233
2013-10-31 18:26:06,283 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 49233
2013-10-31 18:26:06,284 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:06,296 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/job to /tmp/Jetty_localhost_49233_job____4x32wx/webapp
2013-10-31 18:26:06,461 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:49233
2013-10-31 18:26:06,463 INFO  mapred.JobTracker (JobTracker.java:<init>(2347)) - JobTracker up at: 52140
2013-10-31 18:26:06,464 INFO  mapred.JobTracker (JobTracker.java:<init>(2351)) - JobTracker webserver: 49233
2013-10-31 18:26:06,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system	dst=null	perm=null
2013-10-31 18:26:06,473 INFO  mapred.JobTracker (JobTracker.java:<init>(2405)) - Creating the system directory
2013-10-31 18:26:06,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:26:07,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:26:07,027 INFO  mapred.JobTracker (JobTracker.java:<init>(2469)) - History server being initialized in embedded mode
2013-10-31 18:26:07,030 INFO  mapred.JobHistoryServer (JobHistoryServer.java:start(196)) - Started job history server at: localhost:49233
2013-10-31 18:26:07,031 INFO  mapred.JobTracker (JobTracker.java:<init>(2472)) - Job History Server web address: localhost:49233
2013-10-31 18:26:07,033 INFO  mapred.CompletedJobStatusStore (CompletedJobStatusStore.java:<init>(111)) - Completed job store is inactive
2013-10-31 18:26:07,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:07,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info	dst=null	perm=hadoop:supergroup:rw-------
2013-10-31 18:26:07,074 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info. blk_-8976559195179578700_1001
2013-10-31 18:26:07,093 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8976559195179578700_1001 src: /127.0.0.1:48573 dest: /127.0.0.1:34578
2013-10-31 18:26:07,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8976559195179578700_1001 src: /127.0.0.1:41771 dest: /127.0.0.1:59471
2013-10-31 18:26:07,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8976559195179578700_1001 src: /127.0.0.1:45946 dest: /127.0.0.1:54365
2013-10-31 18:26:07,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45946, dest: /127.0.0.1:54365, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8976559195179578700_1001, duration: 2113178
2013-10-31 18:26:07,104 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8976559195179578700_1001 terminating
2013-10-31 18:26:07,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:41771, dest: /127.0.0.1:59471, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8976559195179578700_1001, duration: 3520525
2013-10-31 18:26:07,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8976559195179578700_1001 terminating
2013-10-31 18:26:07,107 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48573, dest: /127.0.0.1:34578, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8976559195179578700_1001, duration: 5020401
2013-10-31 18:26:07,107 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8976559195179578700_1001 terminating
2013-10-31 18:26:07,107 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8976559195179578700_1001 size 4
2013-10-31 18:26:07,111 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8976559195179578700_1001 size 4
2013-10-31 18:26:07,112 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8976559195179578700_1001 size 4
2013-10-31 18:26:07,112 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info from client DFSClient_-1596270109
2013-10-31 18:26:07,112 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info is closed by DFSClient_-1596270109
2013-10-31 18:26:07,117 INFO  mapred.JobTracker (JobTracker.java:refreshHosts(4945)) - Refreshing hosts information
2013-10-31 18:26:07,132 INFO  util.HostsFileReader (HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to 
2013-10-31 18:26:07,132 INFO  util.HostsFileReader (HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to 
2013-10-31 18:26:07,132 INFO  util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 18:26:07,132 INFO  mapred.JobTracker (JobTracker.java:decommissionNodes(4989)) - Decommissioning 0 nodes
2013-10-31 18:26:07,133 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 52140: starting
2013-10-31 18:26:07,133 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 52140: starting
2013-10-31 18:26:07,134 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 52140: starting
2013-10-31 18:26:07,133 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 52140: starting
2013-10-31 18:26:07,133 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:07,135 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 52140: starting
2013-10-31 18:26:07,136 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 52140: starting
2013-10-31 18:26:07,133 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 52140: starting
2013-10-31 18:26:07,135 INFO  mapred.JobTracker (JobTracker.java:offerService(2630)) - Starting RUNNING
2013-10-31 18:26:07,135 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 52140: starting
2013-10-31 18:26:07,135 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 52140: starting
2013-10-31 18:26:07,135 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 52140: starting
2013-10-31 18:26:07,135 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 52140: starting
2013-10-31 18:26:07,192 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0
2013-10-31 18:26:12,209 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:12,227 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:12,231 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:12,231 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0
2013-10-31 18:26:12,260 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-10-31 18:26:12,271 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:12,271 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:12,272 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 33516: starting
2013-10-31 18:26:12,273 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 33516: starting
2013-10-31 18:26:12,273 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 33516: starting
2013-10-31 18:26:12,274 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:33516
2013-10-31 18:26:12,274 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 33516: starting
2013-10-31 18:26:12,273 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 33516: starting
2013-10-31 18:26:12,274 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:26:12,286 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:26:12,295 INFO  util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2013-10-31 18:26:12,301 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@60516af2
2013-10-31 18:26:12,305 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:12,341 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:12,348 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:12,349 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 41705 webServer.getConnectors()[0].getLocalPort() returned 41705
2013-10-31 18:26:12,349 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 41705
2013-10-31 18:26:12,349 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:12,354 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_41705_task____la6d4t/webapp
2013-10-31 18:26:12,507 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:41705
2013-10-31 18:26:12,507 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:12,508 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0
2013-10-31 18:26:12,509 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:15,539 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/10.5.128.102
2013-10-31 18:26:15,542 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:33516 to host 10.5.128.102
2013-10-31 18:26:17,515 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:17,517 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:17,519 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:17,520 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0
2013-10-31 18:26:19,137 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:19,139 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:19,139 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 42022: starting
2013-10-31 18:26:19,141 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 42022: starting
2013-10-31 18:26:19,142 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:42022
2013-10-31 18:26:19,139 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 42022: starting
2013-10-31 18:26:19,139 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 42022: starting
2013-10-31 18:26:19,142 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:26:19,142 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 42022: starting
2013-10-31 18:26:19,148 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@49b639f7
2013-10-31 18:26:19,148 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:26:19,150 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:19,178 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:19,179 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:19,179 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 44527 webServer.getConnectors()[0].getLocalPort() returned 44527
2013-10-31 18:26:19,180 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 44527
2013-10-31 18:26:19,180 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:19,184 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_44527_task____ku89nc/webapp
2013-10-31 18:26:19,336 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:44527
2013-10-31 18:26:19,337 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:19,337 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0
2013-10-31 18:26:19,339 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,377 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,402 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:22,361 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:42022 to host 10.5.128.102
2013-10-31 18:26:24,344 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:24,346 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:24,347 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:24,348 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0
2013-10-31 18:26:24,363 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:24,365 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 48953: starting
2013-10-31 18:26:24,365 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 48953: starting
2013-10-31 18:26:24,366 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 48953: starting
2013-10-31 18:26:24,365 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:24,368 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:48953
2013-10-31 18:26:24,368 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 48953: starting
2013-10-31 18:26:24,367 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 48953: starting
2013-10-31 18:26:24,370 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:26:24,374 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4702a0c1
2013-10-31 18:26:24,374 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:26:24,376 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:24,398 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:24,399 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:24,399 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 59831 webServer.getConnectors()[0].getLocalPort() returned 59831
2013-10-31 18:26:24,399 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 59831
2013-10-31 18:26:24,399 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:24,404 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_59831_task____.sgbkvk/webapp
2013-10-31 18:26:24,555 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:59831
2013-10-31 18:26:24,555 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:24,556 INFO  mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0
2013-10-31 18:26:24,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,557 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,561 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,566 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,566 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,566 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,570 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,570 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,570 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,574 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,574 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,574 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,579 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,579 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,579 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,585 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,585 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,585 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,635 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:27,574 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:48953 to host 10.5.128.102
2013-10-31 18:26:29,565 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:29,567 INFO  mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:29,569 INFO  mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:29,570 INFO  mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0
2013-10-31 18:26:29,599 INFO  ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:29,600 INFO  ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:29,600 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 58210: starting
2013-10-31 18:26:29,602 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 58210: starting
2013-10-31 18:26:29,601 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 58210: starting
2013-10-31 18:26:29,600 INFO  ipc.Server (Server.java:run(435)) - IPC Server listener on 58210: starting
2013-10-31 18:26:29,603 INFO  ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 58210: starting
2013-10-31 18:26:29,603 INFO  mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:58210
2013-10-31 18:26:29,605 INFO  mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:26:29,608 INFO  mapred.TaskTracker (TaskTracker.java:initialize(860)) -  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@511a1546
2013-10-31 18:26:29,608 INFO  mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:26:29,610 WARN  mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:29,635 INFO  mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:29,636 INFO  http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:29,636 INFO  http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 54694 webServer.getConnectors()[0].getLocalPort() returned 54694
2013-10-31 18:26:29,637 INFO  http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 54694
2013-10-31 18:26:29,637 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:29,641 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_54694_task____.hu318w/webapp
2013-10-31 18:26:29,831 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:54694
2013-10-31 18:26:29,832 INFO  mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:29,832 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,833 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,833 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,833 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:32,849 INFO  mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:58210 to host 10.5.128.102
2013-10-31 18:26:33,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,352 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt. blk_695637524992237905_1002
2013-10-31 18:26:33,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_695637524992237905_1002 src: /127.0.0.1:46127 dest: /127.0.0.1:54365
2013-10-31 18:26:33,361 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_695637524992237905_1002 src: /127.0.0.1:48757 dest: /127.0.0.1:34578
2013-10-31 18:26:33,364 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_695637524992237905_1002 src: /127.0.0.1:45846 dest: /127.0.0.1:37740
2013-10-31 18:26:33,373 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45846, dest: /127.0.0.1:37740, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 5913633
2013-10-31 18:26:33,373 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_695637524992237905_1002 terminating
2013-10-31 18:26:33,375 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48757, dest: /127.0.0.1:34578, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 7519417
2013-10-31 18:26:33,376 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_695637524992237905_1002 terminating
2013-10-31 18:26:33,378 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_695637524992237905_1002 size 1449
2013-10-31 18:26:33,379 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46127, dest: /127.0.0.1:54365, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 7843820
2013-10-31 18:26:33,379 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_695637524992237905_1002 size 1449
2013-10-31 18:26:33,380 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_695637524992237905_1002 terminating
2013-10-31 18:26:33,384 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_695637524992237905_1002 size 1449
2013-10-31 18:26:33,384 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt from client DFSClient_-1596270109
2013-10-31 18:26:33,385 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt is closed by DFSClient_-1596270109
2013-10-31 18:26:33,442 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:26:33,443 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:26:33,452 INFO  property.AppProps (AppProps.java:getAppID(162)) - using app.id: 5A418A83440341CFB03287AC626F8D10
2013-10-31 18:26:33,580 INFO  util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.2.0
2013-10-31 18:26:33,584 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:26:33,585 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:26:33,585 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex"]
2013-10-31 18:26:33,586 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:26:33,586 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:26:33,587 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:26:33,588 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pesplatform/filtercomplex
2013-10-31 18:26:33,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:26:33,607 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:26:33,607 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:26:33,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:26:33,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:26:33,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,647 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar. blk_-8119916807805166670_1003
2013-10-31 18:26:33,649 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:41958 dest: /127.0.0.1:59471
2013-10-31 18:26:33,652 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:45850 dest: /127.0.0.1:37740
2013-10-31 18:26:33,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:48763 dest: /127.0.0.1:34578
2013-10-31 18:26:33,674 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48763, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8119916807805166670_1003, duration: 17148128
2013-10-31 18:26:33,675 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8119916807805166670_1003 terminating
2013-10-31 18:26:33,676 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:33,679 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45850, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8119916807805166670_1003, duration: 19916120
2013-10-31 18:26:33,679 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8119916807805166670_1003 terminating
2013-10-31 18:26:33,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:41958, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8119916807805166670_1003, duration: 23111959
2013-10-31 18:26:33,683 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:33,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8119916807805166670_1003 terminating
2013-10-31 18:26:33,688 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:33,689 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar from client DFSClient_-1596270109
2013-10-31 18:26:33,689 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:26:33,697 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar. New replication is 10
2013-10-31 18:26:33,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=null
2013-10-31 18:26:33,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,713 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:26:33,732 WARN  snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2013-10-31 18:26:33,737 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:26:33,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:26:33,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,759 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split. New replication is 10
2013-10-31 18:26:34,322 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-8119916807805166670_1003 to datanode(s) 127.0.0.1:54365
2013-10-31 18:26:35,625 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-8119916807805166670_1003 to 127.0.0.1:54365 
2013-10-31 18:26:35,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:46135 dest: /127.0.0.1:54365
2013-10-31 18:26:35,635 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-8119916807805166670_1003 to /127.0.0.1:54365
2013-10-31 18:26:35,638 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8119916807805166670_1003 src: /127.0.0.1:46135 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:26:35,643 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:41,640 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated DatanodeProtocol.sendHeartbeat 50 raw values into 38 aggregated values, total 38
2013-10-31 18:26:42,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=null
2013-10-31 18:26:42,938 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split. blk_-7169271713417131077_1004
2013-10-31 18:26:42,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:46164 dest: /127.0.0.1:54365
2013-10-31 18:26:42,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:48794 dest: /127.0.0.1:34578
2013-10-31 18:26:42,945 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:45883 dest: /127.0.0.1:37740
2013-10-31 18:26:42,947 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:41993 dest: /127.0.0.1:59471
2013-10-31 18:26:42,954 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:41993, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7169271713417131077_1004, duration: 4273352
2013-10-31 18:26:42,954 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,956 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45883, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7169271713417131077_1004, duration: 6950504
2013-10-31 18:26:42,959 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,962 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48794, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7169271713417131077_1004, duration: 11021296
2013-10-31 18:26:42,963 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,963 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,968 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46164, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7169271713417131077_1004, duration: 17294745
2013-10-31 18:26:42,970 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,974 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,975 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split from client DFSClient_-1596270109
2013-10-31 18:26:42,976 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split is closed by DFSClient_-1596270109
2013-10-31 18:26:42,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:42,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,003 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo. blk_-818079583544537979_1005
2013-10-31 18:26:43,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-818079583544537979_1005 src: /127.0.0.1:48797 dest: /127.0.0.1:34578
2013-10-31 18:26:43,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-818079583544537979_1005 src: /127.0.0.1:45886 dest: /127.0.0.1:37740
2013-10-31 18:26:43,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-818079583544537979_1005 src: /127.0.0.1:46170 dest: /127.0.0.1:54365
2013-10-31 18:26:43,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46170, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-818079583544537979_1005, duration: 3040329
2013-10-31 18:26:43,015 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-818079583544537979_1005 size 156
2013-10-31 18:26:43,015 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-818079583544537979_1005 terminating
2013-10-31 18:26:43,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45886, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-818079583544537979_1005, duration: 5192398
2013-10-31 18:26:43,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-818079583544537979_1005 terminating
2013-10-31 18:26:43,021 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48797, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-818079583544537979_1005, duration: 8001406
2013-10-31 18:26:43,022 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-818079583544537979_1005 terminating
2013-10-31 18:26:43,025 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-818079583544537979_1005 size 156
2013-10-31 18:26:43,025 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:26:43,026 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:26:43,026 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-818079583544537979_1005 size 156
2013-10-31 18:26:43,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,170 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml. blk_3898509533205014241_1006
2013-10-31 18:26:43,171 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3898509533205014241_1006 src: /127.0.0.1:45889 dest: /127.0.0.1:37740
2013-10-31 18:26:43,173 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3898509533205014241_1006 src: /127.0.0.1:48802 dest: /127.0.0.1:34578
2013-10-31 18:26:43,174 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3898509533205014241_1006 src: /127.0.0.1:46174 dest: /127.0.0.1:54365
2013-10-31 18:26:43,178 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46174, dest: /127.0.0.1:54365, bytes: 28656, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3898509533205014241_1006, duration: 3293474
2013-10-31 18:26:43,178 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3898509533205014241_1006 terminating
2013-10-31 18:26:43,180 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3898509533205014241_1006 size 28656
2013-10-31 18:26:43,180 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48802, dest: /127.0.0.1:34578, bytes: 28656, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3898509533205014241_1006, duration: 4591751
2013-10-31 18:26:43,180 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3898509533205014241_1006 terminating
2013-10-31 18:26:43,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45889, dest: /127.0.0.1:37740, bytes: 28656, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3898509533205014241_1006, duration: 6385818
2013-10-31 18:26:43,182 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3898509533205014241_1006 size 28656
2013-10-31 18:26:43,182 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3898509533205014241_1006 terminating
2013-10-31 18:26:43,185 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3898509533205014241_1006 size 28656
2013-10-31 18:26:43,185 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml from client DFSClient_-1596270109
2013-10-31 18:26:43,186 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:26:43,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=null
2013-10-31 18:26:43,211 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48805, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3898509533205014241_1006, duration: 354255
2013-10-31 18:26:43,231 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0001: nMaps=4 nReduces=1 max=-1
2013-10-31 18:26:43,233 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0001 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:26:43,234 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0001	RESULT=SUCCESS
2013-10-31 18:26:43,235 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0001
2013-10-31 18:26:43,235 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0001
2013-10-31 18:26:43,237 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0001
2013-10-31 18:26:43,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,321 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml. blk_-1869663385596486972_1008
2013-10-31 18:26:43,323 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1869663385596486972_1008 src: /127.0.0.1:42005 dest: /127.0.0.1:59471
2013-10-31 18:26:43,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1869663385596486972_1008 src: /127.0.0.1:46180 dest: /127.0.0.1:54365
2013-10-31 18:26:43,325 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1869663385596486972_1008 src: /127.0.0.1:48810 dest: /127.0.0.1:34578
2013-10-31 18:26:43,330 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48810, dest: /127.0.0.1:34578, bytes: 28721, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1869663385596486972_1008, duration: 2806644
2013-10-31 18:26:43,331 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1869663385596486972_1008 terminating
2013-10-31 18:26:43,332 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46180, dest: /127.0.0.1:54365, bytes: 28721, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1869663385596486972_1008, duration: 3823257
2013-10-31 18:26:43,332 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1869663385596486972_1008 terminating
2013-10-31 18:26:43,333 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1869663385596486972_1008 size 28721
2013-10-31 18:26:43,333 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42005, dest: /127.0.0.1:59471, bytes: 28721, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1869663385596486972_1008, duration: 4834412
2013-10-31 18:26:43,333 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1869663385596486972_1008 size 28721
2013-10-31 18:26:43,333 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1869663385596486972_1008 terminating
2013-10-31 18:26:43,335 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml from client DFSClient_-1955967223
2013-10-31 18:26:43,335 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml is closed by DFSClient_-1955967223
2013-10-31 18:26:43,335 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1869663385596486972_1008 size 28721
2013-10-31 18:26:43,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,353 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken. blk_-4029352565037357501_1009
2013-10-31 18:26:43,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4029352565037357501_1009 src: /127.0.0.1:46182 dest: /127.0.0.1:54365
2013-10-31 18:26:43,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4029352565037357501_1009 src: /127.0.0.1:42009 dest: /127.0.0.1:59471
2013-10-31 18:26:43,356 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4029352565037357501_1009 src: /127.0.0.1:48813 dest: /127.0.0.1:34578
2013-10-31 18:26:43,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48813, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4029352565037357501_1009, duration: 1395210
2013-10-31 18:26:43,359 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4029352565037357501_1009 terminating
2013-10-31 18:26:43,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42009, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4029352565037357501_1009, duration: 2195975
2013-10-31 18:26:43,359 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4029352565037357501_1009 terminating
2013-10-31 18:26:43,360 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46182, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4029352565037357501_1009, duration: 3126781
2013-10-31 18:26:43,361 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4029352565037357501_1009 size 116
2013-10-31 18:26:43,361 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4029352565037357501_1009 terminating
2013-10-31 18:26:43,362 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4029352565037357501_1009 size 116
2013-10-31 18:26:43,362 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken from client DFSClient_-1596270109
2013-10-31 18:26:43,363 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:26:43,363 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4029352565037357501_1009 size 116
2013-10-31 18:26:43,367 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken
2013-10-31 18:26:43,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:26:43,371 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45902, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-818079583544537979_1005, duration: 349867
2013-10-31 18:26:43,382 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0001 = 1449. Number of splits = 4
2013-10-31 18:26:43,382 INFO  net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1
2013-10-31 18:26:43,383 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,383 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,383 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,385 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,385 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,385 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,386 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,386 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,386 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0001 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:26:43,388 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0001 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:26:43,433 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0001_m_000005_0' to tip task_20131031182606197_0001_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:26:43,442 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:26:43,446 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000005_0 which needs 1 slots
2013-10-31 18:26:43,447 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000005_0 which needs 1 slots
2013-10-31 18:26:43,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken	dst=null	perm=null
2013-10-31 18:26:43,466 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42012, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4029352565037357501_1009, duration: 577340
2013-10-31 18:26:43,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=null
2013-10-31 18:26:43,490 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45905, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-1061544104, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3898509533205014241_1006, duration: 791685
2013-10-31 18:26:43,533 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:43,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=null
2013-10-31 18:26:43,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46189, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1061544104, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8119916807805166670_1003, duration: 2951356
2013-10-31 18:26:43,723 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1893423327
2013-10-31 18:26:43,724 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1893423327 spawned.
2013-10-31 18:26:43,726 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000005_0/taskjvm.sh
2013-10-31 18:26:45,581 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1893423327 given task: attempt_20131031182606197_0001_m_000005_0
2013-10-31 18:26:46,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:26:49,010 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000005_0 0.0% setup
2013-10-31 18:26:49,014 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000005_0 is done.
2013-10-31 18:26:49,015 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000005_0  was -1
2013-10-31 18:26:49,016 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:49,460 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000005_0' has completed task_20131031182606197_0001_m_000005 successfully.
2013-10-31 18:26:49,472 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000000_0' to tip task_20131031182606197_0001_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:26:49,475 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000000
2013-10-31 18:26:49,478 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:26:49,479 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000000_0 which needs 1 slots
2013-10-31 18:26:49,479 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000000_0 which needs 1 slots
2013-10-31 18:26:49,521 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_-1261202210
2013-10-31 18:26:49,523 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_-1261202210 spawned.
2013-10-31 18:26:49,527 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000000_0/taskjvm.sh
2013-10-31 18:26:50,440 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_-1261202210 given task: attempt_20131031182606197_0001_m_000000_0
2013-10-31 18:26:50,882 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000001_0' to tip task_20131031182606197_0001_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:26:50,884 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000001
2013-10-31 18:26:50,887 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:26:50,887 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000001_0 which needs 1 slots
2013-10-31 18:26:50,887 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000001_0 which needs 1 slots
2013-10-31 18:26:50,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken	dst=null	perm=null
2013-10-31 18:26:50,902 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48874, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4029352565037357501_1009, duration: 230276
2013-10-31 18:26:50,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=null
2013-10-31 18:26:50,917 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45964, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-698521807, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3898509533205014241_1006, duration: 330915
2013-10-31 18:26:50,943 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:50,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=null
2013-10-31 18:26:50,967 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42074, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-698521807, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8119916807805166670_1003, duration: 2086974
2013-10-31 18:26:50,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=null
2013-10-31 18:26:50,981 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46249, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7169271713417131077_1004, duration: 277560
2013-10-31 18:26:51,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:26:51,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46250, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 200338
2013-10-31 18:26:51,052 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1448684247
2013-10-31 18:26:51,053 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1448684247 spawned.
2013-10-31 18:26:51,055 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000001_0/taskjvm.sh
2013-10-31 18:26:51,609 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000002_0' to tip task_20131031182606197_0001_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:26:51,609 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000002
2013-10-31 18:26:51,610 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:26:51,610 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000003_0' to tip task_20131031182606197_0001_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:26:51,610 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000002_0 which needs 1 slots
2013-10-31 18:26:51,611 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000002_0 which needs 1 slots
2013-10-31 18:26:51,611 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000003
2013-10-31 18:26:51,614 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:26:51,614 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000003_0 which needs 1 slots
2013-10-31 18:26:51,615 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000003_0 which needs 1 slots
2013-10-31 18:26:51,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken	dst=null	perm=null
2013-10-31 18:26:51,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken	dst=null	perm=null
2013-10-31 18:26:51,643 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42077, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4029352565037357501_1009, duration: 222951
2013-10-31 18:26:51,645 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48881, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4029352565037357501_1009, duration: 209377
2013-10-31 18:26:51,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=null
2013-10-31 18:26:51,658 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48885, bytes: 28880, op: HDFS_READ, cliID: DFSClient_1803231535, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3898509533205014241_1006, duration: 775168
2013-10-31 18:26:51,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml	dst=null	perm=null
2013-10-31 18:26:51,665 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46259, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-1906851011, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3898509533205014241_1006, duration: 302263
2013-10-31 18:26:51,680 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:51,690 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:51,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=null
2013-10-31 18:26:51,702 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42086, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1803231535, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8119916807805166670_1003, duration: 1350790
2013-10-31 18:26:51,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar	dst=null	perm=null
2013-10-31 18:26:51,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46261, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1906851011, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8119916807805166670_1003, duration: 1413710
2013-10-31 18:26:51,780 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1010257680
2013-10-31 18:26:51,781 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1010257680 spawned.
2013-10-31 18:26:51,782 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000003_0/taskjvm.sh
2013-10-31 18:26:51,786 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1027368877
2013-10-31 18:26:51,786 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1027368877 spawned.
2013-10-31 18:26:51,789 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000002_0/taskjvm.sh
2013-10-31 18:26:52,441 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1448684247 given task: attempt_20131031182606197_0001_m_000001_0
2013-10-31 18:26:52,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=null
2013-10-31 18:26:52,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45991, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7169271713417131077_1004, duration: 263821
2013-10-31 18:26:52,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:26:53,274 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48904, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 289487
2013-10-31 18:26:53,866 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1010257680 given task: attempt_20131031182606197_0001_m_000003_0
2013-10-31 18:26:53,911 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:26:53,914 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000000_0 is done.
2013-10-31 18:26:53,914 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000000_0  was 121
2013-10-31 18:26:53,914 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:54,057 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1027368877 given task: attempt_20131031182606197_0001_m_000002_0
2013-10-31 18:26:54,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=null
2013-10-31 18:26:54,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48914, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7169271713417131077_1004, duration: 200036
2013-10-31 18:26:54,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:26:54,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46286, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 693322
2013-10-31 18:26:54,479 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0001_m_000005_0
2013-10-31 18:26:54,479 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0001_m_000005_0
2013-10-31 18:26:54,479 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0001_m_000005_0 not found in cache
2013-10-31 18:26:54,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split	dst=null	perm=null
2013-10-31 18:26:54,572 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42114, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7169271713417131077_1004, duration: 275702
2013-10-31 18:26:54,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:26:54,611 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46007, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 287584
2013-10-31 18:26:55,490 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000000_0' has completed task_20131031182606197_0001_m_000000 successfully.
2013-10-31 18:26:55,514 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0001_r_000000_0' to tip task_20131031182606197_0001_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:26:55,518 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:26:55,519 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_r_000000_0 which needs 1 slots
2013-10-31 18:26:55,519 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_r_000000_0 which needs 1 slots
2013-10-31 18:26:55,558 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_r_1893423327
2013-10-31 18:26:55,558 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_r_1893423327 spawned.
2013-10-31 18:26:55,562 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_r_000000_0/taskjvm.sh
2013-10-31 18:26:55,861 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:26:55,868 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000001_0 is done.
2013-10-31 18:26:55,868 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000001_0  was 325
2013-10-31 18:26:55,870 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:55,999 INFO  metrics.MetricsUtil (?:emrClusterStarted(?)) - instance controller state completed
2013-10-31 18:26:56,017 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:26:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,077 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,088 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,094 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,100 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,106 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,107 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 42 records
2013-10-31 18:26:56,890 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000001_0' has completed task_20131031182606197_0001_m_000001 successfully.
2013-10-31 18:26:57,281 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:26:57,284 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000003_0 is done.
2013-10-31 18:26:57,284 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000003_0  was 228
2013-10-31 18:26:57,285 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:57,338 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_r_1893423327 given task: attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:26:57,498 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:26:57,501 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000002_0 is done.
2013-10-31 18:26:57,501 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000002_0  was 120
2013-10-31 18:26:57,502 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:57,616 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000002_0' has completed task_20131031182606197_0001_m_000002 successfully.
2013-10-31 18:26:57,619 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000003_0' has completed task_20131031182606197_0001_m_000003 successfully.
2013-10-31 18:27:03,118 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43057, bytes: 121, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000000_0, duration: 36105979
2013-10-31 18:27:03,147 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38361, bytes: 325, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000001_0, duration: 12291867
2013-10-31 18:27:03,169 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40383, bytes: 120, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000002_0, duration: 15316408
2013-10-31 18:27:03,190 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48018, bytes: 228, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000003_0, duration: 13720597
2013-10-31 18:27:03,856 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:03,888 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:03,946 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:04,154 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 60 Total time for transactions(ms): 6Number of transactions batched in Syncs: 0 Number of syncs: 31 SyncTimes(ms): 9576 885 
2013-10-31 18:27:04,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:04,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:04,180 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000. blk_-3193214271390058748_1010
2013-10-31 18:27:04,203 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3193214271390058748_1010 src: /127.0.0.1:46360 dest: /127.0.0.1:54365
2013-10-31 18:27:04,204 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3193214271390058748_1010 src: /127.0.0.1:48990 dest: /127.0.0.1:34578
2013-10-31 18:27:04,205 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3193214271390058748_1010 src: /127.0.0.1:46079 dest: /127.0.0.1:37740
2013-10-31 18:27:04,217 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46079, dest: /127.0.0.1:37740, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0001_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3193214271390058748_1010, duration: 4631463
2013-10-31 18:27:04,217 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3193214271390058748_1010 terminating
2013-10-31 18:27:04,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48990, dest: /127.0.0.1:34578, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0001_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3193214271390058748_1010, duration: 10487716
2013-10-31 18:27:04,224 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3193214271390058748_1010 terminating
2013-10-31 18:27:04,225 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3193214271390058748_1010 size 7
2013-10-31 18:27:04,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46360, dest: /127.0.0.1:54365, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0001_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3193214271390058748_1010, duration: 14443367
2013-10-31 18:27:04,225 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3193214271390058748_1010 size 7
2013-10-31 18:27:04,226 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3193214271390058748_1010 terminating
2013-10-31 18:27:04,228 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:04,228 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:04,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3193214271390058748_1010 size 7
2013-10-31 18:27:04,267 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0001_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:27:04,267 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:04,532 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0001_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:27:04,536 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:05,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0	dst=null	perm=null
2013-10-31 18:27:05,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:05,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:05,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0	dst=null	perm=null
2013-10-31 18:27:06,890 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:06,892 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:06,894 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_r_000000_0 is done.
2013-10-31 18:27:06,894 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_r_000000_0  was -1
2013-10-31 18:27:06,894 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:07,539 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_r_000000_0' has completed task_20131031182606197_0001_r_000000 successfully.
2013-10-31 18:27:07,544 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0001_m_000004_0' to tip task_20131031182606197_0001_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:27:07,546 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:27:07,546 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000004_0 which needs 1 slots
2013-10-31 18:27:07,546 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000004_0 which needs 1 slots
2013-10-31 18:27:07,568 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0001/attempt_20131031182606197_0001_m_000004_0. Attempting to reuse: jvm_20131031182606197_0001_m_-1261202210
2013-10-31 18:27:07,968 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_-1261202210 given task: attempt_20131031182606197_0001_m_000004_0
2013-10-31 18:27:08,100 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000004_0 0.0% 
2013-10-31 18:27:08,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary	dst=null	perm=null
2013-10-31 18:27:08,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:08,120 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_SUCCESS from client DFSClient_attempt_20131031182606197_0001_m_000004_0
2013-10-31 18:27:08,120 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0001_m_000004_0
2013-10-31 18:27:08,127 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,127 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,127 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:08,127 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,127 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:08,127 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-818079583544537979 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-818079583544537979 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-818079583544537979 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3898509533205014241 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3898509533205014241 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,128 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3898509533205014241 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001	dst=null	perm=null
2013-10-31 18:27:10,328 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-7169271713417131077_1004 blk_-8119916807805166670_1003
2013-10-31 18:27:10,329 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_3898509533205014241_1006 blk_-7169271713417131077_1004 blk_-8119916807805166670_1003 blk_-818079583544537979_1005
2013-10-31 18:27:10,923 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data3/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:10,925 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data4/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:10,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-818079583544537979_1005 file build/test/data/dfs/data/data3/current/blk_-818079583544537979 for deletion
2013-10-31 18:27:10,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3898509533205014241_1006 file build/test/data/dfs/data/data4/current/blk_3898509533205014241 for deletion
2013-10-31 18:27:10,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data4/current/blk_-7169271713417131077
2013-10-31 18:27:10,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data3/current/blk_-8119916807805166670
2013-10-31 18:27:10,927 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3898509533205014241_1006 at file build/test/data/dfs/data/data4/current/blk_3898509533205014241
2013-10-31 18:27:10,928 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-818079583544537979_1005 at file build/test/data/dfs/data/data3/current/blk_-818079583544537979
2013-10-31 18:27:11,046 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000004_0 0.0% cleanup
2013-10-31 18:27:11,049 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000004_0 is done.
2013-10-31 18:27:11,049 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000004_0  was -1
2013-10-31 18:27:11,049 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:11,635 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data6/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:11,636 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data5/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:11,637 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data5/current/blk_-7169271713417131077
2013-10-31 18:27:11,637 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data6/current/blk_-8119916807805166670
2013-10-31 18:27:12,546 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:12,547 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:13,329 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_3898509533205014241_1006 blk_-7169271713417131077_1004 blk_-8119916807805166670_1003 blk_-818079583544537979_1005
2013-10-31 18:27:13,330 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_3898509533205014241_1006 blk_-7169271713417131077_1004 blk_-8119916807805166670_1003 blk_-818079583544537979_1005
2013-10-31 18:27:13,555 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000004_0' has completed task_20131031182606197_0001_m_000004 successfully.
2013-10-31 18:27:13,558 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0001 has completed successfully.
2013-10-31 18:27:13,563 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0001,submitTime=1383244003200,launchTime=1383244003387,firstMapTaskLaunchTime=1383244009472,firstReduceTaskLaunchTime=1383244015505,firstJobSetupTaskLaunchTime=1383244003398,firstJobCleanupTaskLaunchTime=1383244027543,finishTime=1383244033558,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=11,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[0DBC7A13253E46468B989E48B430E8C4/152B993DA7C64F6F95F45A3241E871E7] test/(1/1) ...pesplatform/filtercomplex
2013-10-31 18:27:13,570 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F. blk_-3853691654878838440_1011
2013-10-31 18:27:13,572 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3853691654878838440_1011 src: /127.0.0.1:42253 dest: /127.0.0.1:59471
2013-10-31 18:27:13,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3853691654878838440_1011 src: /127.0.0.1:46428 dest: /127.0.0.1:54365
2013-10-31 18:27:13,579 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3853691654878838440_1011 src: /127.0.0.1:49058 dest: /127.0.0.1:34578
2013-10-31 18:27:13,586 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49058, dest: /127.0.0.1:34578, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3853691654878838440_1011, duration: 2776107
2013-10-31 18:27:13,586 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3853691654878838440_1011 terminating
2013-10-31 18:27:13,588 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46428, dest: /127.0.0.1:54365, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3853691654878838440_1011, duration: 4086242
2013-10-31 18:27:13,588 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3853691654878838440_1011 terminating
2013-10-31 18:27:13,589 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3853691654878838440_1011 size 28289
2013-10-31 18:27:13,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42253, dest: /127.0.0.1:59471, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3853691654878838440_1011, duration: 5323239
2013-10-31 18:27:13,590 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3853691654878838440_1011 terminating
2013-10-31 18:27:13,592 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3853691654878838440_1011 size 28289
2013-10-31 18:27:13,593 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F from client DFSClient_-1955967223
2013-10-31 18:27:13,593 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F is closed by DFSClient_-1955967223
2013-10-31 18:27:13,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3853691654878838440_1011 size 28289
2013-10-31 18:27:13,605 INFO  mapred.JobHistory (JobHistory.java:maybeMakeSubdirectory(403)) - Creating DONE subfolder at file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:27:13,607 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:27:13,607 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000000_0'
2013-10-31 18:27:13,608 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000004_0'
2013-10-31 18:27:13,608 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000005_0'
2013-10-31 18:27:13,608 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_r_000000_0'
2013-10-31 18:27:13,611 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4029352565037357501 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:13,611 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4029352565037357501 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:13,611 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4029352565037357501 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:13,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001	dst=null	perm=null
2013-10-31 18:27:13,617 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0001_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:27:13,624 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary
2013-10-31 18:27:13,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex	dst=null	perm=null
2013-10-31 18:27:13,642 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:27:13,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000	dst=null	perm=null
2013-10-31 18:27:13,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000	dst=null	perm=null
2013-10-31 18:27:13,661 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46148, bytes: 11, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3193214271390058748_1010, duration: 436022
2013-10-31 18:27:13,661 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/filtercomplex
2013-10-31 18:27:13,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex	dst=null	perm=null
2013-10-31 18:27:13,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000	dst=null	perm=null
2013-10-31 18:27:13,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46432, bytes: 11, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3193214271390058748_1010, duration: 442943
2013-10-31 18:27:13,687 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:27:13,688 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:27:13,714 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:27:13,714 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:27:13,714 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextDelimited[['ip', 'count1', 'count2', 'count3', 'count4']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain"]
2013-10-31 18:27:13,715 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:27:13,715 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:27:13,715 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:27:13,715 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pipesplatform/simplechain
2013-10-31 18:27:13,720 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:27:13,720 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:27:13,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:13,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:27:13,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,736 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar. blk_-2141313976185548712_1012
2013-10-31 18:27:13,738 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:49062 dest: /127.0.0.1:34578
2013-10-31 18:27:13,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:46151 dest: /127.0.0.1:37740
2013-10-31 18:27:13,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:46435 dest: /127.0.0.1:54365
2013-10-31 18:27:13,748 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46435, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2141313976185548712_1012, duration: 7166426
2013-10-31 18:27:13,748 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2141313976185548712_1012 terminating
2013-10-31 18:27:13,749 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46151, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2141313976185548712_1012, duration: 7904182
2013-10-31 18:27:13,749 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:13,750 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2141313976185548712_1012 terminating
2013-10-31 18:27:13,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49062, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2141313976185548712_1012, duration: 8188079
2013-10-31 18:27:13,751 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2141313976185548712_1012 terminating
2013-10-31 18:27:13,753 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar from client DFSClient_-1596270109
2013-10-31 18:27:13,753 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:27:13,754 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:13,754 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:13,758 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar. New replication is 10
2013-10-31 18:27:13,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=null
2013-10-31 18:27:13,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,769 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:27:13,776 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:27:13,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:27:13,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,793 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split. New replication is 10
2013-10-31 18:27:14,919 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000001_0'
2013-10-31 18:27:15,047 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data1/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:15,048 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data2/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:15,048 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data1/current/blk_-8119916807805166670
2013-10-31 18:27:15,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data2/current/blk_-7169271713417131077
2013-10-31 18:27:15,048 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-818079583544537979_1005 file build/test/data/dfs/data/data1/current/blk_-818079583544537979 for deletion
2013-10-31 18:27:15,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3898509533205014241_1006 file build/test/data/dfs/data/data2/current/blk_3898509533205014241 for deletion
2013-10-31 18:27:15,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-818079583544537979_1005 at file build/test/data/dfs/data/data1/current/blk_-818079583544537979
2013-10-31 18:27:15,050 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3898509533205014241_1006 at file build/test/data/dfs/data/data2/current/blk_3898509533205014241
2013-10-31 18:27:15,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data8/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:15,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data7/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:15,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-818079583544537979_1005 file build/test/data/dfs/data/data8/current/blk_-818079583544537979 for deletion
2013-10-31 18:27:15,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data7/current/blk_-7169271713417131077
2013-10-31 18:27:15,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data8/current/blk_-8119916807805166670
2013-10-31 18:27:15,125 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3898509533205014241_1006 file build/test/data/dfs/data/data7/current/blk_3898509533205014241 for deletion
2013-10-31 18:27:15,125 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-818079583544537979_1005 at file build/test/data/dfs/data/data8/current/blk_-818079583544537979
2013-10-31 18:27:15,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3898509533205014241_1006 at file build/test/data/dfs/data/data7/current/blk_3898509533205014241
2013-10-31 18:27:15,646 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000002_0'
2013-10-31 18:27:15,647 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000003_0'
2013-10-31 18:27:16,330 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2141313976185548712_1012 to datanode(s) 127.0.0.1:59471
2013-10-31 18:27:16,331 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-4029352565037357501_1009
2013-10-31 18:27:16,331 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-4029352565037357501_1009
2013-10-31 18:27:16,925 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2141313976185548712_1012 to 127.0.0.1:59471 
2013-10-31 18:27:16,926 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4029352565037357501_1009 file build/test/data/dfs/data/data4/current/blk_-4029352565037357501 for deletion
2013-10-31 18:27:16,927 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:42268 dest: /127.0.0.1:59471
2013-10-31 18:27:16,928 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2141313976185548712_1012 to /127.0.0.1:59471
2013-10-31 18:27:18,048 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4029352565037357501_1009 file build/test/data/dfs/data/data2/current/blk_-4029352565037357501 for deletion
2013-10-31 18:27:18,609 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:18,610 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0001_m_000004_0 not found in cache
2013-10-31 18:27:18,612 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330438612
2013-10-31 18:27:19,085 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_-1261202210 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:19,100 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15591 with signal TERM. Exit code 0
2013-10-31 18:27:19,192 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1893423327 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:19,203 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15531 with signal TERM. Exit code 0
2013-10-31 18:27:19,267 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4029352565037357501_1009 at file build/test/data/dfs/data/data2/current/blk_-4029352565037357501
2013-10-31 18:27:19,284 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:19,285 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:19,285 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:27:19,285 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_-1261202210 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:27:19,332 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2141313976185548712_1012 to datanode(s) 127.0.0.1:59471
2013-10-31 18:27:19,332 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-4029352565037357501_1009
2013-10-31 18:27:19,360 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:19,360 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:19,361 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:27:19,361 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1893423327 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:19,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4029352565037357501_1009 at file build/test/data/dfs/data/data4/current/blk_-4029352565037357501
2013-10-31 18:27:19,368 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2141313976185548712_1012 src: /127.0.0.1:42268 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:27:19,373 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:19,497 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_r_1893423327 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:19,509 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15874 with signal TERM. Exit code 0
2013-10-31 18:27:19,681 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:19,681 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:19,681 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:27:19,682 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_r_1893423327 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:19,920 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:19,921 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330439921
2013-10-31 18:27:19,926 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2141313976185548712_1012 to 127.0.0.1:59471 
2013-10-31 18:27:19,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:42287 dest: /127.0.0.1:59471
2013-10-31 18:27:19,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(425)) - writeBlock blk_-2141313976185548712_1012 received exception org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException: Block blk_-2141313976185548712_1012 is valid, and cannot be written to.
2013-10-31 18:27:19,929 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2141313976185548712_1012 to /127.0.0.1:59471
2013-10-31 18:27:19,929 ERROR datanode.DataNode (DataXceiver.java:run(136)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):DataXceiver
org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException: Block blk_-2141313976185548712_1012 is valid, and cannot be written to.
	at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1396)
	at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
	at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:304)
	at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:112)
	at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:27:20,459 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1448684247 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:20,472 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15664 with signal TERM. Exit code 0
2013-10-31 18:27:20,637 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4029352565037357501_1009 file build/test/data/dfs/data/data5/current/blk_-4029352565037357501 for deletion
2013-10-31 18:27:20,638 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4029352565037357501_1009 at file build/test/data/dfs/data/data5/current/blk_-4029352565037357501
2013-10-31 18:27:20,647 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:20,648 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330440647
2013-10-31 18:27:20,648 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:20,649 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330440649
2013-10-31 18:27:20,672 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:20,672 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:20,672 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:27:20,672 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1448684247 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:21,850 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1010257680 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:21,865 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15751 with signal TERM. Exit code 0
2013-10-31 18:27:22,070 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:22,070 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:22,070 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1027368877 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:22,070 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:27:22,072 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1010257680 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:22,085 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15786 with signal TERM. Exit code 0
2013-10-31 18:27:22,299 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:22,300 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:22,300 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:27:22,300 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1027368877 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:23,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=null
2013-10-31 18:27:23,096 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split. blk_7633157263478609076_1013
2013-10-31 18:27:23,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:42299 dest: /127.0.0.1:59471
2013-10-31 18:27:23,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:46474 dest: /127.0.0.1:54365
2013-10-31 18:27:23,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:49104 dest: /127.0.0.1:34578
2013-10-31 18:27:23,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:46193 dest: /127.0.0.1:37740
2013-10-31 18:27:23,109 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46193, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7633157263478609076_1013, duration: 3051956
2013-10-31 18:27:23,110 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,111 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49104, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7633157263478609076_1013, duration: 4164155
2013-10-31 18:27:23,112 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,112 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,113 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46474, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7633157263478609076_1013, duration: 4748037
2013-10-31 18:27:23,114 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42299, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7633157263478609076_1013, duration: 6939493
2013-10-31 18:27:23,116 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,118 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,120 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split from client DFSClient_-1596270109
2013-10-31 18:27:23,120 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split is closed by DFSClient_-1596270109
2013-10-31 18:27:23,121 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,121 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,139 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo. blk_1098547203853784091_1014
2013-10-31 18:27:23,141 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1098547203853784091_1014 src: /127.0.0.1:49106 dest: /127.0.0.1:34578
2013-10-31 18:27:23,143 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1098547203853784091_1014 src: /127.0.0.1:46195 dest: /127.0.0.1:37740
2013-10-31 18:27:23,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1098547203853784091_1014 src: /127.0.0.1:42305 dest: /127.0.0.1:59471
2013-10-31 18:27:23,148 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42305, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1098547203853784091_1014, duration: 687959
2013-10-31 18:27:23,149 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1098547203853784091_1014 terminating
2013-10-31 18:27:23,150 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1098547203853784091_1014 size 156
2013-10-31 18:27:23,150 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46195, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1098547203853784091_1014, duration: 2643080
2013-10-31 18:27:23,151 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1098547203853784091_1014 terminating
2013-10-31 18:27:23,152 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49106, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1098547203853784091_1014, duration: 4713377
2013-10-31 18:27:23,153 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1098547203853784091_1014 terminating
2013-10-31 18:27:23,156 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1098547203853784091_1014 size 156
2013-10-31 18:27:23,156 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:27:23,157 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:27:23,157 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1098547203853784091_1014 size 156
2013-10-31 18:27:23,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,192 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml. blk_-5355324456686587546_1015
2013-10-31 18:27:23,194 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5355324456686587546_1015 src: /127.0.0.1:46480 dest: /127.0.0.1:54365
2013-10-31 18:27:23,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5355324456686587546_1015 src: /127.0.0.1:42307 dest: /127.0.0.1:59471
2013-10-31 18:27:23,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5355324456686587546_1015 src: /127.0.0.1:49111 dest: /127.0.0.1:34578
2013-10-31 18:27:23,203 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49111, dest: /127.0.0.1:34578, bytes: 28794, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5355324456686587546_1015, duration: 2359904
2013-10-31 18:27:23,203 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5355324456686587546_1015 terminating
2013-10-31 18:27:23,205 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42307, dest: /127.0.0.1:59471, bytes: 28794, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5355324456686587546_1015, duration: 4314514
2013-10-31 18:27:23,205 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5355324456686587546_1015 terminating
2013-10-31 18:27:23,207 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5355324456686587546_1015 size 28794
2013-10-31 18:27:23,207 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46480, dest: /127.0.0.1:54365, bytes: 28794, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 6535415
2013-10-31 18:27:23,208 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5355324456686587546_1015 terminating
2013-10-31 18:27:23,208 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5355324456686587546_1015 size 28794
2013-10-31 18:27:23,211 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml from client DFSClient_-1596270109
2013-10-31 18:27:23,212 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:27:23,212 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5355324456686587546_1015 size 28794
2013-10-31 18:27:23,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=null
2013-10-31 18:27:23,223 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46484, bytes: 29022, op: HDFS_READ, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 266396
2013-10-31 18:27:23,232 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0002: nMaps=4 nReduces=1 max=-1
2013-10-31 18:27:23,233 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0002 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:27:23,233 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0002	RESULT=SUCCESS
2013-10-31 18:27:23,233 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0002
2013-10-31 18:27:23,234 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0002
2013-10-31 18:27:23,235 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0002
2013-10-31 18:27:23,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,265 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml. blk_5326914040277870060_1017
2013-10-31 18:27:23,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5326914040277870060_1017 src: /127.0.0.1:46202 dest: /127.0.0.1:37740
2013-10-31 18:27:23,267 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5326914040277870060_1017 src: /127.0.0.1:42312 dest: /127.0.0.1:59471
2013-10-31 18:27:23,268 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5326914040277870060_1017 src: /127.0.0.1:46487 dest: /127.0.0.1:54365
2013-10-31 18:27:23,273 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46487, dest: /127.0.0.1:54365, bytes: 28859, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5326914040277870060_1017, duration: 3624755
2013-10-31 18:27:23,274 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5326914040277870060_1017 terminating
2013-10-31 18:27:23,275 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42312, dest: /127.0.0.1:59471, bytes: 28859, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5326914040277870060_1017, duration: 5116969
2013-10-31 18:27:23,275 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5326914040277870060_1017 terminating
2013-10-31 18:27:23,276 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46202, dest: /127.0.0.1:37740, bytes: 28859, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5326914040277870060_1017, duration: 6273902
2013-10-31 18:27:23,277 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5326914040277870060_1017 terminating
2013-10-31 18:27:23,280 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5326914040277870060_1017 size 28859
2013-10-31 18:27:23,281 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml from client DFSClient_-1705714739
2013-10-31 18:27:23,281 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml is closed by DFSClient_-1705714739
2013-10-31 18:27:23,282 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5326914040277870060_1017 size 28859
2013-10-31 18:27:23,282 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5326914040277870060_1017 size 28859
2013-10-31 18:27:23,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,299 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken. blk_2577997513305980578_1018
2013-10-31 18:27:23,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577997513305980578_1018 src: /127.0.0.1:49117 dest: /127.0.0.1:34578
2013-10-31 18:27:23,302 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577997513305980578_1018 src: /127.0.0.1:46489 dest: /127.0.0.1:54365
2013-10-31 18:27:23,304 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577997513305980578_1018 src: /127.0.0.1:42316 dest: /127.0.0.1:59471
2013-10-31 18:27:23,309 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42316, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2577997513305980578_1018, duration: 1884074
2013-10-31 18:27:23,310 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2577997513305980578_1018 terminating
2013-10-31 18:27:23,310 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46489, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2577997513305980578_1018, duration: 2838029
2013-10-31 18:27:23,311 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2577997513305980578_1018 terminating
2013-10-31 18:27:23,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49117, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2577997513305980578_1018, duration: 3990192
2013-10-31 18:27:23,312 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2577997513305980578_1018 terminating
2013-10-31 18:27:23,315 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2577997513305980578_1018 size 116
2013-10-31 18:27:23,316 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken from client DFSClient_-1596270109
2013-10-31 18:27:23,316 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:27:23,317 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2577997513305980578_1018 size 116
2013-10-31 18:27:23,317 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2577997513305980578_1018 size 116
2013-10-31 18:27:23,322 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken
2013-10-31 18:27:23,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:27:23,328 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46208, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1098547203853784091_1014, duration: 402990
2013-10-31 18:27:23,332 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0002 = 1449. Number of splits = 4
2013-10-31 18:27:23,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,332 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,335 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,335 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0002 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:27:23,336 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0002 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:27:23,931 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0002_m_000005_0' to tip task_20131031182606197_0002_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:23,936 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:27:23,937 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000005_0 which needs 1 slots
2013-10-31 18:27:23,937 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000005_0 which needs 1 slots
2013-10-31 18:27:23,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken	dst=null	perm=null
2013-10-31 18:27:23,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42321, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2577997513305980578_1018, duration: 461199
2013-10-31 18:27:23,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=null
2013-10-31 18:27:23,965 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46497, bytes: 29022, op: HDFS_READ, cliID: DFSClient_912982788, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 604137
2013-10-31 18:27:24,005 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:24,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=null
2013-10-31 18:27:24,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46498, bytes: 239915, op: HDFS_READ, cliID: DFSClient_912982788, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2141313976185548712_1012, duration: 2216858
2013-10-31 18:27:24,141 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_519201635
2013-10-31 18:27:24,142 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_519201635 spawned.
2013-10-31 18:27:24,145 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000005_0/taskjvm.sh
2013-10-31 18:27:26,364 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_519201635 given task: attempt_20131031182606197_0002_m_000005_0
2013-10-31 18:27:26,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:29,823 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000005_0 0.0% setup
2013-10-31 18:27:29,827 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000005_0 is done.
2013-10-31 18:27:29,828 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000005_0  was -1
2013-10-31 18:27:29,828 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:29,944 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000005_0' has completed task_20131031182606197_0002_m_000005 successfully.
2013-10-31 18:27:29,950 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000000_0' to tip task_20131031182606197_0002_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:29,952 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000000
2013-10-31 18:27:29,954 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:27:29,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000000_0 which needs 1 slots
2013-10-31 18:27:29,955 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000000_0 which needs 1 slots
2013-10-31 18:27:29,996 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_-710253377
2013-10-31 18:27:29,997 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_-710253377 spawned.
2013-10-31 18:27:30,000 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000000_0/taskjvm.sh
2013-10-31 18:27:30,671 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000001_0' to tip task_20131031182606197_0002_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:27:30,672 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000001
2013-10-31 18:27:30,673 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:27:30,674 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000001_0 which needs 1 slots
2013-10-31 18:27:30,674 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000001_0 which needs 1 slots
2013-10-31 18:27:30,674 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000002_0' to tip task_20131031182606197_0002_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:27:30,674 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000002
2013-10-31 18:27:30,676 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:27:30,676 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000002_0 which needs 1 slots
2013-10-31 18:27:30,676 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000002_0 which needs 1 slots
2013-10-31 18:27:30,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken	dst=null	perm=null
2013-10-31 18:27:30,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken	dst=null	perm=null
2013-10-31 18:27:30,688 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46505, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2577997513305980578_1018, duration: 417267
2013-10-31 18:27:30,690 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49135, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2577997513305980578_1018, duration: 196525
2013-10-31 18:27:30,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=null
2013-10-31 18:27:30,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=null
2013-10-31 18:27:30,697 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49138, bytes: 29022, op: HDFS_READ, cliID: DFSClient_-781359484, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5355324456686587546_1015, duration: 256052
2013-10-31 18:27:30,698 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46510, bytes: 29022, op: HDFS_READ, cliID: DFSClient_-808314366, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 261310
2013-10-31 18:27:30,716 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:30,716 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:30,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=null
2013-10-31 18:27:30,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=null
2013-10-31 18:27:30,737 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49140, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-808314366, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2141313976185548712_1012, duration: 1338908
2013-10-31 18:27:30,737 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46229, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-781359484, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2141313976185548712_1012, duration: 1354546
2013-10-31 18:27:30,806 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_1834196118
2013-10-31 18:27:30,806 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_-2128071556
2013-10-31 18:27:30,807 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_1834196118 spawned.
2013-10-31 18:27:30,807 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_-2128071556 spawned.
2013-10-31 18:27:30,809 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000001_0/taskjvm.sh
2013-10-31 18:27:30,809 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000002_0/taskjvm.sh
2013-10-31 18:27:31,409 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-710253377 given task: attempt_20131031182606197_0002_m_000000_0
2013-10-31 18:27:31,629 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000003_0' to tip task_20131031182606197_0002_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:27:31,629 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000003
2013-10-31 18:27:31,630 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:27:31,630 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000003_0 which needs 1 slots
2013-10-31 18:27:31,630 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000003_0 which needs 1 slots
2013-10-31 18:27:31,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken	dst=null	perm=null
2013-10-31 18:27:31,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46514, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2577997513305980578_1018, duration: 195747
2013-10-31 18:27:31,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml	dst=null	perm=null
2013-10-31 18:27:31,643 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46516, bytes: 29022, op: HDFS_READ, cliID: DFSClient_1518586653, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 247252
2013-10-31 18:27:31,658 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:31,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar	dst=null	perm=null
2013-10-31 18:27:31,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46517, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1518586653, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2141313976185548712_1012, duration: 1221177
2013-10-31 18:27:31,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=null
2013-10-31 18:27:31,927 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49148, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7633157263478609076_1013, duration: 555660
2013-10-31 18:27:31,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:27:31,970 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46237, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 387762
2013-10-31 18:27:33,743 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_-1747545474
2013-10-31 18:27:33,744 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_-1747545474 spawned.
2013-10-31 18:27:33,748 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000003_0/taskjvm.sh
2013-10-31 18:27:34,549 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-2128071556 given task: attempt_20131031182606197_0002_m_000001_0
2013-10-31 18:27:34,840 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:27:34,842 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000000_0 is done.
2013-10-31 18:27:34,842 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000000_0  was 54
2013-10-31 18:27:34,842 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:34,877 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_1834196118 given task: attempt_20131031182606197_0002_m_000002_0
2013-10-31 18:27:34,950 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-1747545474 given task: attempt_20131031182606197_0002_m_000003_0
2013-10-31 18:27:34,955 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0002_m_000005_0
2013-10-31 18:27:34,955 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0002_m_000005_0
2013-10-31 18:27:34,955 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0002_m_000005_0 not found in cache
2013-10-31 18:27:35,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=null
2013-10-31 18:27:35,052 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46528, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7633157263478609076_1013, duration: 256947
2013-10-31 18:27:35,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:27:35,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46247, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 264175
2013-10-31 18:27:35,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=null
2013-10-31 18:27:35,384 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42358, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7633157263478609076_1013, duration: 246113
2013-10-31 18:27:35,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:27:35,423 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46533, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 256550
2013-10-31 18:27:35,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split	dst=null	perm=null
2013-10-31 18:27:35,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42360, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7633157263478609076_1013, duration: 179661
2013-10-31 18:27:35,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:27:35,492 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49164, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 236302
2013-10-31 18:27:35,963 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000000_0' has completed task_20131031182606197_0002_m_000000 successfully.
2013-10-31 18:27:35,967 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0002_r_000000_0' to tip task_20131031182606197_0002_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:36,014 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:27:36,014 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_r_000000_0 which needs 1 slots
2013-10-31 18:27:36,015 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_r_000000_0 which needs 1 slots
2013-10-31 18:27:36,036 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_r_1448684247
2013-10-31 18:27:36,037 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_r_1448684247 spawned.
2013-10-31 18:27:36,038 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_r_000000_0/taskjvm.sh
2013-10-31 18:27:37,977 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:27:37,981 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000001_0 is done.
2013-10-31 18:27:37,981 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000001_0  was 74
2013-10-31 18:27:37,982 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:38,306 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:27:38,307 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000002_0 is done.
2013-10-31 18:27:38,308 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000002_0  was 73
2013-10-31 18:27:38,308 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:38,379 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:27:38,382 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000003_0 is done.
2013-10-31 18:27:38,382 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000003_0  was 53
2013-10-31 18:27:38,383 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:38,983 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_r_1448684247 given task: attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:39,691 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000001_0' has completed task_20131031182606197_0002_m_000001 successfully.
2013-10-31 18:27:39,695 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000002_0' has completed task_20131031182606197_0002_m_000002 successfully.
2013-10-31 18:27:40,641 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000003_0' has completed task_20131031182606197_0002_m_000003 successfully.
2013-10-31 18:27:44,700 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38549, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000000_0, duration: 9324732
2013-10-31 18:27:44,728 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40571, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000001_0, duration: 13263839
2013-10-31 18:27:44,746 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48206, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000002_0, duration: 12970897
2013-10-31 18:27:44,764 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43249, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000003_0, duration: 12961983
2013-10-31 18:27:45,485 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:45,561 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:45,624 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:45,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:47,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:47,580 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000. blk_-4839348806796864519_1019
2013-10-31 18:27:47,622 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4839348806796864519_1019 src: /127.0.0.1:46260 dest: /127.0.0.1:37740
2013-10-31 18:27:47,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4839348806796864519_1019 src: /127.0.0.1:46544 dest: /127.0.0.1:54365
2013-10-31 18:27:47,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4839348806796864519_1019 src: /127.0.0.1:42371 dest: /127.0.0.1:59471
2013-10-31 18:27:47,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42371, dest: /127.0.0.1:59471, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0002_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4839348806796864519_1019, duration: 2911943
2013-10-31 18:27:47,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4839348806796864519_1019 terminating
2013-10-31 18:27:47,632 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46544, dest: /127.0.0.1:54365, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0002_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4839348806796864519_1019, duration: 4555341
2013-10-31 18:27:47,632 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4839348806796864519_1019 terminating
2013-10-31 18:27:47,632 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4839348806796864519_1019 size 176
2013-10-31 18:27:47,633 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46260, dest: /127.0.0.1:37740, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0002_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4839348806796864519_1019, duration: 5630100
2013-10-31 18:27:47,633 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4839348806796864519_1019 terminating
2013-10-31 18:27:47,633 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4839348806796864519_1019 size 176
2013-10-31 18:27:47,635 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:47,636 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:47,637 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4839348806796864519_1019 size 176
2013-10-31 18:27:47,672 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0002_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:27:47,672 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:48,030 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0002_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:27:48,033 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:48,534 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:48,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0	dst=null	perm=null
2013-10-31 18:27:48,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:48,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:48,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0	dst=null	perm=null
2013-10-31 18:27:51,574 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:51,578 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:51,580 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_r_000000_0 is done.
2013-10-31 18:27:51,580 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_r_000000_0  was -1
2013-10-31 18:27:51,581 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:54,040 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_r_000000_0' has completed task_20131031182606197_0002_r_000000 successfully.
2013-10-31 18:27:56,009 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:27:56,017 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,041 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,048 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:27:57,548 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0002_m_000004_0' to tip task_20131031182606197_0002_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:57,551 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:27:57,551 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000004_0 which needs 1 slots
2013-10-31 18:27:57,552 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000004_0 which needs 1 slots
2013-10-31 18:27:57,581 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0002/attempt_20131031182606197_0002_m_000004_0. Attempting to reuse: jvm_20131031182606197_0002_m_-710253377
2013-10-31 18:27:57,911 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-710253377 given task: attempt_20131031182606197_0002_m_000004_0
2013-10-31 18:27:58,035 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000004_0 0.0% 
2013-10-31 18:27:58,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary	dst=null	perm=null
2013-10-31 18:27:58,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:58,056 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_SUCCESS from client DFSClient_attempt_20131031182606197_0002_m_000004_0
2013-10-31 18:27:58,057 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0002_m_000004_0
2013-10-31 18:27:58,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:58,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1098547203853784091 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1098547203853784091 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1098547203853784091 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5355324456686587546 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5355324456686587546 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5355324456686587546 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:58,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002	dst=null	perm=null
2013-10-31 18:27:58,338 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-5355324456686587546_1015 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:27:58,338 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_1098547203853784091_1014 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:27:58,939 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5355324456686587546_1015 file build/test/data/dfs/data/data3/current/blk_-5355324456686587546 for deletion
2013-10-31 18:27:58,939 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data3/current/blk_-2141313976185548712 for deletion
2013-10-31 18:27:58,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5355324456686587546_1015 at file build/test/data/dfs/data/data3/current/blk_-5355324456686587546
2013-10-31 18:27:58,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data4/current/blk_7633157263478609076 for deletion
2013-10-31 18:27:58,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data3/current/blk_-2141313976185548712
2013-10-31 18:27:58,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data4/current/blk_7633157263478609076
2013-10-31 18:28:00,138 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data7/current/blk_-2141313976185548712 for deletion
2013-10-31 18:28:00,138 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1098547203853784091_1014 file build/test/data/dfs/data/data7/current/blk_1098547203853784091 for deletion
2013-10-31 18:28:00,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data7/current/blk_-2141313976185548712
2013-10-31 18:28:00,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data8/current/blk_7633157263478609076 for deletion
2013-10-31 18:28:00,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1098547203853784091_1014 at file build/test/data/dfs/data/data7/current/blk_1098547203853784091
2013-10-31 18:28:00,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data8/current/blk_7633157263478609076
2013-10-31 18:28:00,988 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000004_0 0.0% cleanup
2013-10-31 18:28:00,990 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000004_0 is done.
2013-10-31 18:28:00,991 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000004_0  was -1
2013-10-31 18:28:00,991 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:01,339 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-5355324456686587546_1015 blk_1098547203853784091_1014 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:28:01,339 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-5355324456686587546_1015 blk_1098547203853784091_1014 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:28:02,552 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:28:02,552 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:28:02,652 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5355324456686587546_1015 file build/test/data/dfs/data/data6/current/blk_-5355324456686587546 for deletion
2013-10-31 18:28:02,652 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data5/current/blk_-2141313976185548712 for deletion
2013-10-31 18:28:02,653 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5355324456686587546_1015 at file build/test/data/dfs/data/data6/current/blk_-5355324456686587546
2013-10-31 18:28:02,653 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data5/current/blk_-2141313976185548712
2013-10-31 18:28:02,653 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1098547203853784091_1014 file build/test/data/dfs/data/data5/current/blk_1098547203853784091 for deletion
2013-10-31 18:28:02,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1098547203853784091_1014 at file build/test/data/dfs/data/data5/current/blk_1098547203853784091
2013-10-31 18:28:02,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data6/current/blk_7633157263478609076 for deletion
2013-10-31 18:28:02,655 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data6/current/blk_7633157263478609076
2013-10-31 18:28:03,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5355324456686587546_1015 file build/test/data/dfs/data/data2/current/blk_-5355324456686587546 for deletion
2013-10-31 18:28:03,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data1/current/blk_-2141313976185548712 for deletion
2013-10-31 18:28:03,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1098547203853784091_1014 file build/test/data/dfs/data/data1/current/blk_1098547203853784091 for deletion
2013-10-31 18:28:03,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data2/current/blk_7633157263478609076 for deletion
2013-10-31 18:28:03,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data1/current/blk_-2141313976185548712
2013-10-31 18:28:03,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5355324456686587546_1015 at file build/test/data/dfs/data/data2/current/blk_-5355324456686587546
2013-10-31 18:28:03,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1098547203853784091_1014 at file build/test/data/dfs/data/data1/current/blk_1098547203853784091
2013-10-31 18:28:03,064 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data2/current/blk_7633157263478609076
2013-10-31 18:28:03,599 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000004_0' has completed task_20131031182606197_0002_m_000004 successfully.
2013-10-31 18:28:03,601 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0002 has completed successfully.
2013-10-31 18:28:03,601 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0002,submitTime=1383244043217,launchTime=1383244043335,firstMapTaskLaunchTime=1383244049950,firstReduceTaskLaunchTime=1383244055967,firstJobSetupTaskLaunchTime=1383244043931,firstJobCleanupTaskLaunchTime=1383244077547,finishTime=1383244083601,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=15,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[F209A64EAB6A419D895DEAA1AF79ADDD/BE9B10B1F8E84FA6B13F3479451BF843] test/(1/1) ...pipesplatform/simplechain
2013-10-31 18:28:03,606 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6. blk_-4203961431443320417_1020
2013-10-31 18:28:03,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4203961431443320417_1020 src: /127.0.0.1:46267 dest: /127.0.0.1:37740
2013-10-31 18:28:03,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4203961431443320417_1020 src: /127.0.0.1:42377 dest: /127.0.0.1:59471
2013-10-31 18:28:03,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4203961431443320417_1020 src: /127.0.0.1:46552 dest: /127.0.0.1:54365
2013-10-31 18:28:03,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46552, dest: /127.0.0.1:54365, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4203961431443320417_1020, duration: 3439307
2013-10-31 18:28:03,614 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4203961431443320417_1020 terminating
2013-10-31 18:28:03,614 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4203961431443320417_1020 size 28304
2013-10-31 18:28:03,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42377, dest: /127.0.0.1:59471, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4203961431443320417_1020, duration: 5324303
2013-10-31 18:28:03,616 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4203961431443320417_1020 terminating
2013-10-31 18:28:03,617 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46267, dest: /127.0.0.1:37740, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4203961431443320417_1020, duration: 6840849
2013-10-31 18:28:03,617 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4203961431443320417_1020 terminating
2013-10-31 18:28:03,618 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4203961431443320417_1020 size 28304
2013-10-31 18:28:03,619 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 from client DFSClient_-1705714739
2013-10-31 18:28:03,619 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 is closed by DFSClient_-1705714739
2013-10-31 18:28:03,619 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4203961431443320417_1020 size 28304
2013-10-31 18:28:03,626 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:03,629 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000000_0'
2013-10-31 18:28:03,629 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000004_0'
2013-10-31 18:28:03,629 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000005_0'
2013-10-31 18:28:03,629 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_r_000000_0'
2013-10-31 18:28:03,629 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577997513305980578 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:03,630 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577997513305980578 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:03,630 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577997513305980578 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:03,633 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0002_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:03,639 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary
2013-10-31 18:28:03,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002	dst=null	perm=null
2013-10-31 18:28:03,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain	dst=null	perm=null
2013-10-31 18:28:03,702 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:03,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000	dst=null	perm=null
2013-10-31 18:28:03,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000	dst=null	perm=null
2013-10-31 18:28:03,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46271, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4839348806796864519_1019, duration: 351336
2013-10-31 18:28:03,713 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simplechain
2013-10-31 18:28:03,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain	dst=null	perm=null
2013-10-31 18:28:03,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000	dst=null	perm=null
2013-10-31 18:28:03,724 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46272, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4839348806796864519_1019, duration: 325583
2013-10-31 18:28:03,745 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:28:03,746 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:28:03,765 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:28:03,766 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:28:03,766 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple"]
2013-10-31 18:28:03,767 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:28:03,767 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:28:03,767 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:28:03,768 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...eldedpipesplatform/simple
2013-10-31 18:28:03,776 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:28:03,776 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:28:03,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:03,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:28:03,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,803 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar. blk_2161431310787054464_1021
2013-10-31 18:28:03,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:46273 dest: /127.0.0.1:37740
2013-10-31 18:28:03,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:49186 dest: /127.0.0.1:34578
2013-10-31 18:28:03,808 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:42384 dest: /127.0.0.1:59471
2013-10-31 18:28:03,820 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42384, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2161431310787054464_1021, duration: 8622578
2013-10-31 18:28:03,821 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2161431310787054464_1021 terminating
2013-10-31 18:28:03,822 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49186, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2161431310787054464_1021, duration: 10152071
2013-10-31 18:28:03,822 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:03,822 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2161431310787054464_1021 terminating
2013-10-31 18:28:03,823 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46273, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2161431310787054464_1021, duration: 12358815
2013-10-31 18:28:03,824 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2161431310787054464_1021 terminating
2013-10-31 18:28:03,826 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar from client DFSClient_-1596270109
2013-10-31 18:28:03,826 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:28:03,827 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:03,827 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:03,832 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar. New replication is 10
2013-10-31 18:28:03,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=null
2013-10-31 18:28:03,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,843 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:28:03,849 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:03,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:03,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,867 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split. New replication is 10
2013-10-31 18:28:03,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=null
2013-10-31 18:28:03,876 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split. blk_1895370450695675842_1022
2013-10-31 18:28:03,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:46276 dest: /127.0.0.1:37740
2013-10-31 18:28:03,880 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:46560 dest: /127.0.0.1:54365
2013-10-31 18:28:03,881 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:49190 dest: /127.0.0.1:34578
2013-10-31 18:28:03,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:42388 dest: /127.0.0.1:59471
2013-10-31 18:28:03,887 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42388, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1895370450695675842_1022, duration: 987671
2013-10-31 18:28:03,888 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,889 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49190, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1895370450695675842_1022, duration: 2527051
2013-10-31 18:28:03,889 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,890 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,891 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46560, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1895370450695675842_1022, duration: 4343509
2013-10-31 18:28:03,891 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,891 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46276, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1895370450695675842_1022, duration: 6187780
2013-10-31 18:28:03,893 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,895 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,896 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split from client DFSClient_-1596270109
2013-10-31 18:28:03,896 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split is closed by DFSClient_-1596270109
2013-10-31 18:28:04,340 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_2161431310787054464_1021 to datanode(s) 127.0.0.1:54365
2013-10-31 18:28:04,340 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_2577997513305980578_1018
2013-10-31 18:28:04,341 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_2577997513305980578_1018
2013-10-31 18:28:04,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,648 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 133 Total time for transactions(ms): 6Number of transactions batched in Syncs: 4 Number of syncs: 86 SyncTimes(ms): 18017 4417 
2013-10-31 18:28:04,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,654 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo. blk_3560951954507469203_1023
2013-10-31 18:28:04,656 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560951954507469203_1023 src: /127.0.0.1:46280 dest: /127.0.0.1:37740
2013-10-31 18:28:04,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560951954507469203_1023 src: /127.0.0.1:42390 dest: /127.0.0.1:59471
2013-10-31 18:28:04,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560951954507469203_1023 src: /127.0.0.1:46565 dest: /127.0.0.1:54365
2013-10-31 18:28:04,663 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46565, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3560951954507469203_1023, duration: 798415
2013-10-31 18:28:04,664 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3560951954507469203_1023 terminating
2013-10-31 18:28:04,665 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42390, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3560951954507469203_1023, duration: 2392277
2013-10-31 18:28:04,665 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3560951954507469203_1023 size 156
2013-10-31 18:28:04,666 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3560951954507469203_1023 terminating
2013-10-31 18:28:04,667 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3560951954507469203_1023 size 156
2013-10-31 18:28:04,667 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46280, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3560951954507469203_1023, duration: 4395728
2013-10-31 18:28:04,668 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3560951954507469203_1023 terminating
2013-10-31 18:28:04,670 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:28:04,670 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:28:04,672 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3560951954507469203_1023 size 156
2013-10-31 18:28:04,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,694 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml. blk_8381546173571133180_1024
2013-10-31 18:28:04,696 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8381546173571133180_1024 src: /127.0.0.1:49195 dest: /127.0.0.1:34578
2013-10-31 18:28:04,698 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8381546173571133180_1024 src: /127.0.0.1:42393 dest: /127.0.0.1:59471
2013-10-31 18:28:04,700 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8381546173571133180_1024 src: /127.0.0.1:46285 dest: /127.0.0.1:37740
2013-10-31 18:28:04,703 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46285, dest: /127.0.0.1:37740, bytes: 28129, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8381546173571133180_1024, duration: 2244273
2013-10-31 18:28:04,704 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8381546173571133180_1024 terminating
2013-10-31 18:28:04,705 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8381546173571133180_1024 size 28129
2013-10-31 18:28:04,706 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42393, dest: /127.0.0.1:59471, bytes: 28129, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 3433267
2013-10-31 18:28:04,706 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8381546173571133180_1024 size 28129
2013-10-31 18:28:04,706 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8381546173571133180_1024 terminating
2013-10-31 18:28:04,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49195, dest: /127.0.0.1:34578, bytes: 28129, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8381546173571133180_1024, duration: 5498877
2013-10-31 18:28:04,708 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8381546173571133180_1024 terminating
2013-10-31 18:28:04,710 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml from client DFSClient_-1596270109
2013-10-31 18:28:04,710 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:28:04,711 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8381546173571133180_1024 size 28129
2013-10-31 18:28:04,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=null
2013-10-31 18:28:04,731 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46287, bytes: 28349, op: HDFS_READ, cliID: DFSClient_-598798051, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8381546173571133180_1024, duration: 546318
2013-10-31 18:28:04,751 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0003: nMaps=4 nReduces=1 max=-1
2013-10-31 18:28:04,753 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0003 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:28:04,753 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0003	RESULT=SUCCESS
2013-10-31 18:28:04,753 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0003
2013-10-31 18:28:04,754 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0003
2013-10-31 18:28:04,754 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0003
2013-10-31 18:28:04,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,795 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml. blk_6154256141097845787_1026
2013-10-31 18:28:04,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6154256141097845787_1026 src: /127.0.0.1:42397 dest: /127.0.0.1:59471
2013-10-31 18:28:04,799 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6154256141097845787_1026 src: /127.0.0.1:46572 dest: /127.0.0.1:54365
2013-10-31 18:28:04,801 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6154256141097845787_1026 src: /127.0.0.1:49202 dest: /127.0.0.1:34578
2013-10-31 18:28:04,806 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49202, dest: /127.0.0.1:34578, bytes: 28194, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6154256141097845787_1026, duration: 1506855
2013-10-31 18:28:04,806 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6154256141097845787_1026 terminating
2013-10-31 18:28:04,807 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46572, dest: /127.0.0.1:54365, bytes: 28194, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6154256141097845787_1026, duration: 3039447
2013-10-31 18:28:04,808 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6154256141097845787_1026 terminating
2013-10-31 18:28:04,810 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42397, dest: /127.0.0.1:59471, bytes: 28194, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6154256141097845787_1026, duration: 5696353
2013-10-31 18:28:04,810 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6154256141097845787_1026 size 28194
2013-10-31 18:28:04,810 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6154256141097845787_1026 terminating
2013-10-31 18:28:04,812 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6154256141097845787_1026 size 28194
2013-10-31 18:28:04,813 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml from client DFSClient_-598798051
2013-10-31 18:28:04,813 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml is closed by DFSClient_-598798051
2013-10-31 18:28:04,813 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6154256141097845787_1026 size 28194
2013-10-31 18:28:04,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,825 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken. blk_1264182116435781743_1027
2013-10-31 18:28:04,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1264182116435781743_1027 src: /127.0.0.1:46291 dest: /127.0.0.1:37740
2013-10-31 18:28:04,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1264182116435781743_1027 src: /127.0.0.1:42401 dest: /127.0.0.1:59471
2013-10-31 18:28:04,830 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1264182116435781743_1027 src: /127.0.0.1:49205 dest: /127.0.0.1:34578
2013-10-31 18:28:04,838 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49205, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1264182116435781743_1027, duration: 2252011
2013-10-31 18:28:04,838 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1264182116435781743_1027 terminating
2013-10-31 18:28:04,838 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1264182116435781743_1027 size 116
2013-10-31 18:28:04,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42401, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1264182116435781743_1027, duration: 3153445
2013-10-31 18:28:04,839 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1264182116435781743_1027 terminating
2013-10-31 18:28:04,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46291, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1264182116435781743_1027, duration: 4054846
2013-10-31 18:28:04,840 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1264182116435781743_1027 terminating
2013-10-31 18:28:04,842 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken from client DFSClient_-1596270109
2013-10-31 18:28:04,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:28:04,843 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1264182116435781743_1027 size 116
2013-10-31 18:28:04,843 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1264182116435781743_1027 size 116
2013-10-31 18:28:04,847 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken
2013-10-31 18:28:04,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:28:04,857 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46294, bytes: 160, op: HDFS_READ, cliID: DFSClient_-598798051, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3560951954507469203_1023, duration: 351873
2013-10-31 18:28:04,861 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0003 = 1449. Number of splits = 4
2013-10-31 18:28:04,861 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,861 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,861 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,862 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,862 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,862 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,864 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,864 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,864 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0003 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:28:04,865 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0003 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:28:04,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577997513305980578_1018 file build/test/data/dfs/data/data3/current/blk_2577997513305980578 for deletion
2013-10-31 18:28:04,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577997513305980578_1018 at file build/test/data/dfs/data/data3/current/blk_2577997513305980578
2013-10-31 18:28:06,064 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_2161431310787054464_1021 to 127.0.0.1:54365 
2013-10-31 18:28:06,065 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577997513305980578_1018 file build/test/data/dfs/data/data1/current/blk_2577997513305980578 for deletion
2013-10-31 18:28:06,065 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577997513305980578_1018 at file build/test/data/dfs/data/data1/current/blk_2577997513305980578
2013-10-31 18:28:06,066 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:46578 dest: /127.0.0.1:54365
2013-10-31 18:28:06,067 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_2161431310787054464_1021 to /127.0.0.1:54365
2013-10-31 18:28:06,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_2161431310787054464_1021 src: /127.0.0.1:46578 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:28:06,072 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:06,564 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0003_m_000005_0' to tip task_20131031182606197_0003_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:06,568 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000002_0'
2013-10-31 18:28:06,570 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000003_0'
2013-10-31 18:28:06,571 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:28:06,571 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000005_0 which needs 1 slots
2013-10-31 18:28:06,571 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000005_0 which needs 1 slots
2013-10-31 18:28:06,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken	dst=null	perm=null
2013-10-31 18:28:06,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46296, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1264182116435781743_1027, duration: 349261
2013-10-31 18:28:06,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=null
2013-10-31 18:28:06,585 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49210, bytes: 28349, op: HDFS_READ, cliID: DFSClient_-1351708163, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8381546173571133180_1024, duration: 508847
2013-10-31 18:28:06,600 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:06,601 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000001_0'
2013-10-31 18:28:06,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=null
2013-10-31 18:28:06,624 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46582, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1351708163, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2161431310787054464_1021, duration: 2349848
2013-10-31 18:28:06,741 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_259930158
2013-10-31 18:28:06,742 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_259930158 spawned.
2013-10-31 18:28:06,745 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000005_0/taskjvm.sh
2013-10-31 18:28:07,341 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_2577997513305980578_1018
2013-10-31 18:28:08,631 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:08,631 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0002_m_000004_0 not found in cache
2013-10-31 18:28:08,632 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330488632
2013-10-31 18:28:08,639 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_r_1448684247 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:08,649 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16557 with signal TERM. Exit code 0
2013-10-31 18:28:08,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577997513305980578_1018 file build/test/data/dfs/data/data6/current/blk_2577997513305980578 for deletion
2013-10-31 18:28:08,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577997513305980578_1018 at file build/test/data/dfs/data/data6/current/blk_2577997513305980578
2013-10-31 18:28:08,815 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:08,815 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:08,815 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:08,815 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_r_1448684247 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:09,023 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_-710253377 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:09,033 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16282 with signal TERM. Exit code 0
2013-10-31 18:28:09,216 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:09,216 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:09,216 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:09,216 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_-710253377 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:28:09,896 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_519201635 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:09,904 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16214 with signal TERM. Exit code 0
2013-10-31 18:28:10,071 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:10,071 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:10,071 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:10,071 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_519201635 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:10,443 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_259930158 given task: attempt_20131031182606197_0003_m_000005_0
2013-10-31 18:28:10,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:11,571 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:11,571 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:11,573 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330491572
2013-10-31 18:28:11,573 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330491573
2013-10-31 18:28:11,602 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:11,603 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330491603
2013-10-31 18:28:11,758 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_-2128071556 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:11,769 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16391 with signal TERM. Exit code 0
2013-10-31 18:28:11,893 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_1834196118 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:11,898 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16426 with signal TERM. Exit code 0
2013-10-31 18:28:11,966 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_-1747545474 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:11,971 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16461 with signal TERM. Exit code 0
2013-10-31 18:28:11,990 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:11,990 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:11,990 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:11,990 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_-2128071556 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:12,086 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:12,086 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:12,086 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:12,086 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_1834196118 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:12,180 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:12,180 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:12,180 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:12,180 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_-1747545474 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:13,875 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000005_0 0.0% setup
2013-10-31 18:28:13,879 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000005_0 is done.
2013-10-31 18:28:13,880 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000005_0  was -1
2013-10-31 18:28:13,880 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:15,584 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000005_0' has completed task_20131031182606197_0003_m_000005 successfully.
2013-10-31 18:28:15,588 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000000_0' to tip task_20131031182606197_0003_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:15,589 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000000
2013-10-31 18:28:15,591 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:28:15,591 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000000_0 which needs 1 slots
2013-10-31 18:28:15,591 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000001_0' to tip task_20131031182606197_0003_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:28:15,591 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000000_0 which needs 1 slots
2013-10-31 18:28:15,594 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000001
2013-10-31 18:28:15,597 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:28:15,598 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000001_0 which needs 1 slots
2013-10-31 18:28:15,598 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000001_0 which needs 1 slots
2013-10-31 18:28:15,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken	dst=null	perm=null
2013-10-31 18:28:15,604 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49215, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1264182116435781743_1027, duration: 371567
2013-10-31 18:28:15,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=null
2013-10-31 18:28:15,611 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42414, bytes: 28349, op: HDFS_READ, cliID: DFSClient_-707125352, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 277597
2013-10-31 18:28:15,612 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000002_0' to tip task_20131031182606197_0003_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:28:15,612 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000002
2013-10-31 18:28:15,614 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:28:15,614 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000002_0 which needs 1 slots
2013-10-31 18:28:15,614 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000002_0 which needs 1 slots
2013-10-31 18:28:15,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken	dst=null	perm=null
2013-10-31 18:28:15,622 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46306, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1264182116435781743_1027, duration: 361636
2013-10-31 18:28:15,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=null
2013-10-31 18:28:15,629 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42417, bytes: 28349, op: HDFS_READ, cliID: DFSClient_490291153, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 219044
2013-10-31 18:28:15,630 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:15,637 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_-1824933735
2013-10-31 18:28:15,637 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_-1824933735 spawned.
2013-10-31 18:28:15,639 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000000_0/taskjvm.sh
2013-10-31 18:28:15,644 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:15,645 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000003_0' to tip task_20131031182606197_0003_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:28:15,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=null
2013-10-31 18:28:15,653 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49221, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-707125352, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2161431310787054464_1021, duration: 1023536
2013-10-31 18:28:15,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=null
2013-10-31 18:28:15,664 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42419, bytes: 239915, op: HDFS_READ, cliID: DFSClient_490291153, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2161431310787054464_1021, duration: 1064725
2013-10-31 18:28:15,681 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000003
2013-10-31 18:28:15,682 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:28:15,683 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000003_0 which needs 1 slots
2013-10-31 18:28:15,683 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000003_0 which needs 1 slots
2013-10-31 18:28:15,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken	dst=null	perm=null
2013-10-31 18:28:15,688 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42420, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1264182116435781743_1027, duration: 162751
2013-10-31 18:28:15,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml	dst=null	perm=null
2013-10-31 18:28:15,694 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42422, bytes: 28349, op: HDFS_READ, cliID: DFSClient_1597706183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 212822
2013-10-31 18:28:15,710 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:15,717 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_606975538
2013-10-31 18:28:15,717 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_606975538 spawned.
2013-10-31 18:28:15,719 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000001_0/taskjvm.sh
2013-10-31 18:28:15,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar	dst=null	perm=null
2013-10-31 18:28:15,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42423, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1597706183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2161431310787054464_1021, duration: 1016231
2013-10-31 18:28:15,731 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_-594210753
2013-10-31 18:28:15,732 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_-594210753 spawned.
2013-10-31 18:28:15,733 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000002_0/taskjvm.sh
2013-10-31 18:28:16,461 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_1908169258
2013-10-31 18:28:16,461 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_1908169258 spawned.
2013-10-31 18:28:16,463 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000003_0/taskjvm.sh
2013-10-31 18:28:16,543 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_-1824933735 given task: attempt_20131031182606197_0003_m_000000_0
2013-10-31 18:28:17,281 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_606975538 given task: attempt_20131031182606197_0003_m_000001_0
2013-10-31 18:28:17,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=null
2013-10-31 18:28:17,324 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49230, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1895370450695675842_1022, duration: 208299
2013-10-31 18:28:17,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:17,364 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49231, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 139444
2013-10-31 18:28:17,734 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_1908169258 given task: attempt_20131031182606197_0003_m_000003_0
2013-10-31 18:28:17,758 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_-594210753 given task: attempt_20131031182606197_0003_m_000002_0
2013-10-31 18:28:17,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=null
2013-10-31 18:28:17,781 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46606, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1895370450695675842_1022, duration: 201975
2013-10-31 18:28:17,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:18,071 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46324, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 220863
2013-10-31 18:28:18,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=null
2013-10-31 18:28:18,241 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49239, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1895370450695675842_1022, duration: 158320
2013-10-31 18:28:18,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split	dst=null	perm=null
2013-10-31 18:28:18,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46328, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1895370450695675842_1022, duration: 204455
2013-10-31 18:28:18,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:18,281 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46329, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000003_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 202479
2013-10-31 18:28:18,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:18,301 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46613, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 238979
2013-10-31 18:28:20,249 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:28:20,253 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000000_0 is done.
2013-10-31 18:28:20,253 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000000_0  was 54
2013-10-31 18:28:20,254 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:20,591 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0003_m_000005_0
2013-10-31 18:28:20,592 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0003_m_000005_0
2013-10-31 18:28:20,592 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0003_m_000005_0 not found in cache
2013-10-31 18:28:20,708 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:28:20,711 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000001_0 is done.
2013-10-31 18:28:20,711 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000001_0  was 74
2013-10-31 18:28:20,711 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:21,003 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 93 raw values into 1 aggregated values, total 24
2013-10-31 18:28:21,172 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:28:21,175 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000003_0 is done.
2013-10-31 18:28:21,176 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000003_0  was 53
2013-10-31 18:28:21,176 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:21,193 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:28:21,195 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000002_0 is done.
2013-10-31 18:28:21,195 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000002_0  was 73
2013-10-31 18:28:21,195 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:21,596 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000000_0' has completed task_20131031182606197_0003_m_000000 successfully.
2013-10-31 18:28:21,796 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0003_r_000000_0' to tip task_20131031182606197_0003_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:21,798 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000003_0' has completed task_20131031182606197_0003_m_000003 successfully.
2013-10-31 18:28:21,800 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:28:21,801 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_r_000000_0 which needs 1 slots
2013-10-31 18:28:21,801 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_r_000000_0 which needs 1 slots
2013-10-31 18:28:21,804 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000002_0' has completed task_20131031182606197_0003_m_000002 successfully.
2013-10-31 18:28:21,812 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000001_0' has completed task_20131031182606197_0003_m_000001 successfully.
2013-10-31 18:28:21,840 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_r_1010257680
2013-10-31 18:28:21,841 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_r_1010257680 spawned.
2013-10-31 18:28:21,842 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_r_000000_0/taskjvm.sh
2013-10-31 18:28:22,827 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_r_1010257680 given task: attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:28,522 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48281, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000000_0, duration: 5994958
2013-10-31 18:28:28,534 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38627, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000003_0, duration: 6112963
2013-10-31 18:28:28,553 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40649, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000002_0, duration: 13241719
2013-10-31 18:28:28,571 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43326, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000001_0, duration: 13180727
2013-10-31 18:28:29,342 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:28:29,396 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:28:29,451 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:28:29,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:29,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:29,699 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000. blk_7660263542163941150_1028
2013-10-31 18:28:29,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7660263542163941150_1028 src: /127.0.0.1:46620 dest: /127.0.0.1:54365
2013-10-31 18:28:29,743 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7660263542163941150_1028 src: /127.0.0.1:49250 dest: /127.0.0.1:34578
2013-10-31 18:28:29,744 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7660263542163941150_1028 src: /127.0.0.1:42448 dest: /127.0.0.1:59471
2013-10-31 18:28:29,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42448, dest: /127.0.0.1:59471, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0003_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7660263542163941150_1028, duration: 2932937
2013-10-31 18:28:29,750 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7660263542163941150_1028 terminating
2013-10-31 18:28:29,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49250, dest: /127.0.0.1:34578, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0003_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7660263542163941150_1028, duration: 5192331
2013-10-31 18:28:29,752 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7660263542163941150_1028 terminating
2013-10-31 18:28:29,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46620, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0003_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7660263542163941150_1028, duration: 6923836
2013-10-31 18:28:29,753 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7660263542163941150_1028 terminating
2013-10-31 18:28:29,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7660263542163941150_1028 size 128
2013-10-31 18:28:29,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7660263542163941150_1028 size 128
2013-10-31 18:28:29,756 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7660263542163941150_1028 size 128
2013-10-31 18:28:29,756 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:29,756 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:30,811 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0003_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:28:32,395 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:34,554 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0003_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:28:34,554 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:35,435 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:36,821 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:37,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0	dst=null	perm=null
2013-10-31 18:28:37,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:37,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:37,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0	dst=null	perm=null
2013-10-31 18:28:38,476 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:38,479 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:38,480 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_r_000000_0 is done.
2013-10-31 18:28:38,480 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_r_000000_0  was -1
2013-10-31 18:28:38,481 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:39,824 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_r_000000_0' has completed task_20131031182606197_0003_r_000000 successfully.
2013-10-31 18:28:39,830 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0003_m_000004_0' to tip task_20131031182606197_0003_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:39,833 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:28:39,833 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000004_0 which needs 1 slots
2013-10-31 18:28:39,833 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000004_0 which needs 1 slots
2013-10-31 18:28:39,864 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0003/attempt_20131031182606197_0003_m_000004_0. Attempting to reuse: jvm_20131031182606197_0003_m_259930158
2013-10-31 18:28:40,026 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_259930158 given task: attempt_20131031182606197_0003_m_000004_0
2013-10-31 18:28:40,137 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000004_0 0.0% 
2013-10-31 18:28:40,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary	dst=null	perm=null
2013-10-31 18:28:40,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:40,164 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_SUCCESS from client DFSClient_attempt_20131031182606197_0003_m_000004_0
2013-10-31 18:28:40,164 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0003_m_000004_0
2013-10-31 18:28:40,169 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:40,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3560951954507469203 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:40,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3560951954507469203 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3560951954507469203 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8381546173571133180 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8381546173571133180 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,171 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8381546173571133180 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:40,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003	dst=null	perm=null
2013-10-31 18:28:40,347 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1895370450695675842_1022 blk_8381546173571133180_1024 blk_2161431310787054464_1021
2013-10-31 18:28:40,347 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_3560951954507469203_1023 blk_1895370450695675842_1022 blk_8381546173571133180_1024 blk_2161431310787054464_1021
2013-10-31 18:28:41,665 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data6/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:41,666 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data5/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:41,666 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data6/current/blk_1895370450695675842
2013-10-31 18:28:41,666 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3560951954507469203_1023 file build/test/data/dfs/data/data5/current/blk_3560951954507469203 for deletion
2013-10-31 18:28:41,666 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data5/current/blk_2161431310787054464
2013-10-31 18:28:41,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8381546173571133180_1024 file build/test/data/dfs/data/data6/current/blk_8381546173571133180 for deletion
2013-10-31 18:28:41,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3560951954507469203_1023 at file build/test/data/dfs/data/data5/current/blk_3560951954507469203
2013-10-31 18:28:41,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8381546173571133180_1024 at file build/test/data/dfs/data/data6/current/blk_8381546173571133180
2013-10-31 18:28:42,076 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data1/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:42,076 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data2/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:42,076 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data1/current/blk_1895370450695675842
2013-10-31 18:28:42,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8381546173571133180_1024 file build/test/data/dfs/data/data2/current/blk_8381546173571133180 for deletion
2013-10-31 18:28:42,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data2/current/blk_2161431310787054464
2013-10-31 18:28:42,077 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8381546173571133180_1024 at file build/test/data/dfs/data/data2/current/blk_8381546173571133180
2013-10-31 18:28:43,108 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000004_0 0.0% cleanup
2013-10-31 18:28:43,111 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000004_0 is done.
2013-10-31 18:28:43,111 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000004_0  was -1
2013-10-31 18:28:43,112 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:43,348 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_3560951954507469203_1023 blk_1895370450695675842_1022 blk_8381546173571133180_1024 blk_2161431310787054464_1021
2013-10-31 18:28:43,348 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_3560951954507469203_1023 blk_1895370450695675842_1022 blk_2161431310787054464_1021
2013-10-31 18:28:43,954 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data4/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:43,954 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data3/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:43,954 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data4/current/blk_1895370450695675842
2013-10-31 18:28:43,955 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3560951954507469203_1023 file build/test/data/dfs/data/data3/current/blk_3560951954507469203 for deletion
2013-10-31 18:28:43,955 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data3/current/blk_2161431310787054464
2013-10-31 18:28:43,955 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3560951954507469203_1023 at file build/test/data/dfs/data/data3/current/blk_3560951954507469203
2013-10-31 18:28:44,833 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:44,834 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:45,153 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data8/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:45,153 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data7/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:45,153 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data8/current/blk_1895370450695675842
2013-10-31 18:28:45,154 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3560951954507469203_1023 file build/test/data/dfs/data/data7/current/blk_3560951954507469203 for deletion
2013-10-31 18:28:45,154 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data7/current/blk_2161431310787054464
2013-10-31 18:28:45,154 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8381546173571133180_1024 file build/test/data/dfs/data/data8/current/blk_8381546173571133180 for deletion
2013-10-31 18:28:45,154 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3560951954507469203_1023 at file build/test/data/dfs/data/data7/current/blk_3560951954507469203
2013-10-31 18:28:45,155 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8381546173571133180_1024 at file build/test/data/dfs/data/data8/current/blk_8381546173571133180
2013-10-31 18:28:45,841 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000004_0' has completed task_20131031182606197_0003_m_000004 successfully.
2013-10-31 18:28:45,844 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0003 has completed successfully.
2013-10-31 18:28:45,844 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0003,submitTime=1383244084715,launchTime=1383244084864,firstMapTaskLaunchTime=1383244095588,firstReduceTaskLaunchTime=1383244101795,firstJobSetupTaskLaunchTime=1383244086563,firstJobCleanupTaskLaunchTime=1383244119830,finishTime=1383244125844,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E5DB2886D3A746B881D7928E706D5EE1/0203F118D1D645E186861FA7ADE890C0] test/(1/1) ...eldedpipesplatform/simple
2013-10-31 18:28:45,854 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1. blk_-2544570674502979241_1029
2013-10-31 18:28:45,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2544570674502979241_1029 src: /127.0.0.1:46630 dest: /127.0.0.1:54365
2013-10-31 18:28:45,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2544570674502979241_1029 src: /127.0.0.1:46348 dest: /127.0.0.1:37740
2013-10-31 18:28:45,860 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2544570674502979241_1029 src: /127.0.0.1:42458 dest: /127.0.0.1:59471
2013-10-31 18:28:45,870 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42458, dest: /127.0.0.1:59471, bytes: 28300, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2544570674502979241_1029, duration: 6166119
2013-10-31 18:28:45,871 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2544570674502979241_1029 terminating
2013-10-31 18:28:45,872 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46348, dest: /127.0.0.1:37740, bytes: 28300, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2544570674502979241_1029, duration: 6363878
2013-10-31 18:28:45,872 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2544570674502979241_1029 terminating
2013-10-31 18:28:45,874 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46630, dest: /127.0.0.1:54365, bytes: 28300, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2544570674502979241_1029, duration: 7735398
2013-10-31 18:28:45,874 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2544570674502979241_1029 size 28300
2013-10-31 18:28:45,875 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2544570674502979241_1029 terminating
2013-10-31 18:28:45,878 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2544570674502979241_1029 size 28300
2013-10-31 18:28:45,879 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 from client DFSClient_-598798051
2013-10-31 18:28:45,879 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 is closed by DFSClient_-598798051
2013-10-31 18:28:45,879 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2544570674502979241_1029 size 28300
2013-10-31 18:28:45,886 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:45,887 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000000_0'
2013-10-31 18:28:45,888 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000004_0'
2013-10-31 18:28:45,888 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000005_0'
2013-10-31 18:28:45,890 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_r_000000_0'
2013-10-31 18:28:45,890 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1264182116435781743 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:45,890 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1264182116435781743 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:45,890 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000002_0'
2013-10-31 18:28:45,891 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1264182116435781743 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:45,891 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000001_0'
2013-10-31 18:28:45,892 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000003_0'
2013-10-31 18:28:45,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003	dst=null	perm=null
2013-10-31 18:28:45,896 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0003_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:45,900 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary
2013-10-31 18:28:45,910 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:45,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:45,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:28:45,915 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46634, bytes: 1461, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 652217
2013-10-31 18:28:45,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple	dst=null	perm=null
2013-10-31 18:28:45,925 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:45,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000	dst=null	perm=null
2013-10-31 18:28:45,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000	dst=null	perm=null
2013-10-31 18:28:45,929 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49264, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7660263542163941150_1028, duration: 466646
2013-10-31 18:28:45,929 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simple
2013-10-31 18:28:45,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple	dst=null	perm=null
2013-10-31 18:28:45,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000	dst=null	perm=null
2013-10-31 18:28:45,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49265, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7660263542163941150_1028, duration: 367722
2013-10-31 18:28:45,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:45,948 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt. blk_4102379777415512644_1030
2013-10-31 18:28:45,949 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4102379777415512644_1030 src: /127.0.0.1:46637 dest: /127.0.0.1:54365
2013-10-31 18:28:45,950 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4102379777415512644_1030 src: /127.0.0.1:42464 dest: /127.0.0.1:59471
2013-10-31 18:28:45,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4102379777415512644_1030 src: /127.0.0.1:46356 dest: /127.0.0.1:37740
2013-10-31 18:28:45,954 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46356, dest: /127.0.0.1:37740, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 1108863
2013-10-31 18:28:45,955 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4102379777415512644_1030 terminating
2013-10-31 18:28:45,956 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42464, dest: /127.0.0.1:59471, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 2676056
2013-10-31 18:28:45,956 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4102379777415512644_1030 size 19
2013-10-31 18:28:45,956 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4102379777415512644_1030 terminating
2013-10-31 18:28:45,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46637, dest: /127.0.0.1:54365, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 4524513
2013-10-31 18:28:45,958 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4102379777415512644_1030 terminating
2013-10-31 18:28:45,958 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4102379777415512644_1030 size 19
2013-10-31 18:28:45,961 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt from client DFSClient_-1596270109
2013-10-31 18:28:45,961 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt is closed by DFSClient_-1596270109
2013-10-31 18:28:45,961 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4102379777415512644_1030 size 19
2013-10-31 18:28:45,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:45,974 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt. blk_3135295757712174631_1031
2013-10-31 18:28:45,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3135295757712174631_1031 src: /127.0.0.1:46640 dest: /127.0.0.1:54365
2013-10-31 18:28:45,978 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3135295757712174631_1031 src: /127.0.0.1:49270 dest: /127.0.0.1:34578
2013-10-31 18:28:45,979 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3135295757712174631_1031 src: /127.0.0.1:46359 dest: /127.0.0.1:37740
2013-10-31 18:28:45,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46359, dest: /127.0.0.1:37740, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 1182049
2013-10-31 18:28:45,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3135295757712174631_1031 terminating
2013-10-31 18:28:45,985 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49270, dest: /127.0.0.1:34578, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 2848975
2013-10-31 18:28:45,985 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3135295757712174631_1031 terminating
2013-10-31 18:28:45,987 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46640, dest: /127.0.0.1:54365, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 4551829
2013-10-31 18:28:45,987 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3135295757712174631_1031 terminating
2013-10-31 18:28:45,990 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3135295757712174631_1031 size 19
2013-10-31 18:28:45,991 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt from client DFSClient_-1596270109
2013-10-31 18:28:45,991 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt is closed by DFSClient_-1596270109
2013-10-31 18:28:45,992 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3135295757712174631_1031 size 19
2013-10-31 18:28:45,992 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3135295757712174631_1031 size 19
2013-10-31 18:28:46,015 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:28:46,015 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:28:46,033 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] starting
2013-10-31 18:28:46,033 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 18:28:46,033 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:28:46,033 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge"]
2013-10-31 18:28:46,034 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  parallel execution is enabled: true
2013-10-31 18:28:46,034 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  starting jobs: 1
2013-10-31 18:28:46,034 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  allocating threads: 1
2013-10-31 18:28:46,035 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] starting step: (1/1) ...pipesplatform/simplemerge
2013-10-31 18:28:46,041 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:28:46,042 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:28:46,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:46,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:28:46,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,066 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar. blk_-9189823900633492842_1032
2013-10-31 18:28:46,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:49272 dest: /127.0.0.1:34578
2013-10-31 18:28:46,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:46361 dest: /127.0.0.1:37740
2013-10-31 18:28:46,072 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:46645 dest: /127.0.0.1:54365
2013-10-31 18:28:46,084 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46645, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9189823900633492842_1032, duration: 8650853
2013-10-31 18:28:46,085 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9189823900633492842_1032 terminating
2013-10-31 18:28:46,086 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:46,086 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46361, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9189823900633492842_1032, duration: 10349115
2013-10-31 18:28:46,087 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9189823900633492842_1032 terminating
2013-10-31 18:28:46,088 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49272, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9189823900633492842_1032, duration: 12403428
2013-10-31 18:28:46,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:46,089 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9189823900633492842_1032 terminating
2013-10-31 18:28:46,091 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:46,092 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar from client DFSClient_-1596270109
2013-10-31 18:28:46,092 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:28:46,100 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar. New replication is 10
2013-10-31 18:28:46,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar	dst=null	perm=null
2013-10-31 18:28:46,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,112 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:28:46,116 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:28:46,118 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:28:46,120 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:28:46,121 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:28:46,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,135 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split. New replication is 10
2013-10-31 18:28:46,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:46,143 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split. blk_-1962318321612106766_1033
2013-10-31 18:28:46,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:46646 dest: /127.0.0.1:54365
2013-10-31 18:28:46,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:46364 dest: /127.0.0.1:37740
2013-10-31 18:28:46,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:42474 dest: /127.0.0.1:59471
2013-10-31 18:28:46,148 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:49278 dest: /127.0.0.1:34578
2013-10-31 18:28:46,151 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49278, dest: /127.0.0.1:34578, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1962318321612106766_1033, duration: 746106
2013-10-31 18:28:46,152 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,153 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42474, dest: /127.0.0.1:59471, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 1785726
2013-10-31 18:28:46,153 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,154 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46364, dest: /127.0.0.1:37740, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1962318321612106766_1033, duration: 3207353
2013-10-31 18:28:46,154 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,155 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46646, dest: /127.0.0.1:54365, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1962318321612106766_1033, duration: 4377765
2013-10-31 18:28:46,155 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,156 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,158 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,158 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split from client DFSClient_-1596270109
2013-10-31 18:28:46,158 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split is closed by DFSClient_-1596270109
2013-10-31 18:28:46,159 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,160 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,349 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-9189823900633492842_1032 to datanode(s) 127.0.0.1:59471
2013-10-31 18:28:46,349 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_1264182116435781743_1027
2013-10-31 18:28:46,349 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_1264182116435781743_1027
2013-10-31 18:28:47,667 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1264182116435781743_1027 file build/test/data/dfs/data/data6/current/blk_1264182116435781743 for deletion
2013-10-31 18:28:47,668 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1264182116435781743_1027 at file build/test/data/dfs/data/data6/current/blk_1264182116435781743
2013-10-31 18:28:47,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,866 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo. blk_9217066690358023305_1034
2013-10-31 18:28:47,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9217066690358023305_1034 src: /127.0.0.1:49279 dest: /127.0.0.1:34578
2013-10-31 18:28:47,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9217066690358023305_1034 src: /127.0.0.1:46651 dest: /127.0.0.1:54365
2013-10-31 18:28:47,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9217066690358023305_1034 src: /127.0.0.1:42478 dest: /127.0.0.1:59471
2013-10-31 18:28:47,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42478, dest: /127.0.0.1:59471, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9217066690358023305_1034, duration: 833576
2013-10-31 18:28:47,876 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9217066690358023305_1034 terminating
2013-10-31 18:28:47,877 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9217066690358023305_1034 size 218
2013-10-31 18:28:47,877 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46651, dest: /127.0.0.1:54365, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9217066690358023305_1034, duration: 2602716
2013-10-31 18:28:47,878 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9217066690358023305_1034 terminating
2013-10-31 18:28:47,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49279, dest: /127.0.0.1:34578, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9217066690358023305_1034, duration: 4456683
2013-10-31 18:28:47,880 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9217066690358023305_1034 terminating
2013-10-31 18:28:47,883 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9217066690358023305_1034 size 218
2013-10-31 18:28:47,883 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:28:47,884 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:28:47,884 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9217066690358023305_1034 size 218
2013-10-31 18:28:47,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,910 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml. blk_4845321285802585100_1035
2013-10-31 18:28:47,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4845321285802585100_1035 src: /127.0.0.1:49282 dest: /127.0.0.1:34578
2013-10-31 18:28:47,914 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4845321285802585100_1035 src: /127.0.0.1:46654 dest: /127.0.0.1:54365
2013-10-31 18:28:47,915 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4845321285802585100_1035 src: /127.0.0.1:42481 dest: /127.0.0.1:59471
2013-10-31 18:28:47,924 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42481, dest: /127.0.0.1:59471, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4845321285802585100_1035, duration: 2326187
2013-10-31 18:28:47,924 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4845321285802585100_1035 terminating
2013-10-31 18:28:47,925 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46654, dest: /127.0.0.1:54365, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4845321285802585100_1035, duration: 3200110
2013-10-31 18:28:47,925 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4845321285802585100_1035 terminating
2013-10-31 18:28:47,925 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4845321285802585100_1035 size 28233
2013-10-31 18:28:47,925 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49282, dest: /127.0.0.1:34578, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4845321285802585100_1035, duration: 4149911
2013-10-31 18:28:47,926 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4845321285802585100_1035 terminating
2013-10-31 18:28:47,926 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4845321285802585100_1035 size 28233
2013-10-31 18:28:47,929 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml from client DFSClient_-1596270109
2013-10-31 18:28:47,930 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:28:47,930 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4845321285802585100_1035 size 28233
2013-10-31 18:28:47,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml	dst=null	perm=null
2013-10-31 18:28:47,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42483, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4845321285802585100_1035, duration: 527491
2013-10-31 18:28:47,970 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0004: nMaps=6 nReduces=1 max=-1
2013-10-31 18:28:47,970 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0004 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:28:47,971 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0004	RESULT=SUCCESS
2013-10-31 18:28:47,971 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0004
2013-10-31 18:28:47,971 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0004
2013-10-31 18:28:47,973 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] submitted hadoop job: job_20131031182606197_0004
2013-10-31 18:28:47,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,992 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml. blk_7295626289958709819_1037
2013-10-31 18:28:47,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7295626289958709819_1037 src: /127.0.0.1:49287 dest: /127.0.0.1:34578
2013-10-31 18:28:47,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7295626289958709819_1037 src: /127.0.0.1:46659 dest: /127.0.0.1:54365
2013-10-31 18:28:47,995 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7295626289958709819_1037 src: /127.0.0.1:46377 dest: /127.0.0.1:37740
2013-10-31 18:28:47,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46377, dest: /127.0.0.1:37740, bytes: 28298, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7295626289958709819_1037, duration: 579644
2013-10-31 18:28:47,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7295626289958709819_1037 terminating
2013-10-31 18:28:47,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46659, dest: /127.0.0.1:54365, bytes: 28298, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7295626289958709819_1037, duration: 1514744
2013-10-31 18:28:47,998 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7295626289958709819_1037 terminating
2013-10-31 18:28:47,999 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49287, dest: /127.0.0.1:34578, bytes: 28298, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7295626289958709819_1037, duration: 2354262
2013-10-31 18:28:47,999 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7295626289958709819_1037 terminating
2013-10-31 18:28:48,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7295626289958709819_1037 size 28298
2013-10-31 18:28:48,002 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7295626289958709819_1037 size 28298
2013-10-31 18:28:48,003 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7295626289958709819_1037 size 28298
2013-10-31 18:28:48,078 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-9189823900633492842_1032 to 127.0.0.1:59471 
2013-10-31 18:28:48,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:42487 dest: /127.0.0.1:59471
2013-10-31 18:28:48,080 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-9189823900633492842_1032 to /127.0.0.1:59471
2013-10-31 18:28:48,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-9189823900633492842_1032 src: /127.0.0.1:42487 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:28:48,085 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:48,154 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1264182116435781743_1027 file build/test/data/dfs/data/data7/current/blk_1264182116435781743 for deletion
2013-10-31 18:28:48,154 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1264182116435781743_1027 at file build/test/data/dfs/data/data7/current/blk_1264182116435781743
2013-10-31 18:28:48,402 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml from client DFSClient_-1078423659
2013-10-31 18:28:48,403 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml is closed by DFSClient_-1078423659
2013-10-31 18:28:48,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:48,415 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken. blk_-3563572431240499727_1038
2013-10-31 18:28:48,417 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3563572431240499727_1038 src: /127.0.0.1:46662 dest: /127.0.0.1:54365
2013-10-31 18:28:48,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3563572431240499727_1038 src: /127.0.0.1:42489 dest: /127.0.0.1:59471
2013-10-31 18:28:48,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3563572431240499727_1038 src: /127.0.0.1:49293 dest: /127.0.0.1:34578
2013-10-31 18:28:48,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49293, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 1124238
2013-10-31 18:28:48,425 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3563572431240499727_1038 terminating
2013-10-31 18:28:48,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42489, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3563572431240499727_1038, duration: 2648559
2013-10-31 18:28:48,426 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3563572431240499727_1038 size 116
2013-10-31 18:28:48,426 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3563572431240499727_1038 terminating
2013-10-31 18:28:48,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46662, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3563572431240499727_1038, duration: 4800046
2013-10-31 18:28:48,428 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3563572431240499727_1038 size 116
2013-10-31 18:28:48,429 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3563572431240499727_1038 terminating
2013-10-31 18:28:48,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3563572431240499727_1038 size 116
2013-10-31 18:28:48,431 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken from client DFSClient_-1596270109
2013-10-31 18:28:48,431 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:28:48,437 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken
2013-10-31 18:28:48,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:28:48,442 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46665, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9217066690358023305_1034, duration: 337354
2013-10-31 18:28:48,444 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0004 = 38. Number of splits = 6
2013-10-31 18:28:48,444 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,444 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,446 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,446 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,446 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,449 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,449 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0004 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:28:48,450 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0004 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:28:48,895 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0004_m_000007_0' to tip task_20131031182606197_0004_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:48,904 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:28:48,904 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000007_0 which needs 1 slots
2013-10-31 18:28:48,905 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000007_0 which needs 1 slots
2013-10-31 18:28:48,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken	dst=null	perm=null
2013-10-31 18:28:48,915 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49295, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 348307
2013-10-31 18:28:48,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml	dst=null	perm=null
2013-10-31 18:28:48,928 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46668, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-1585629740, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4845321285802585100_1035, duration: 488756
2013-10-31 18:28:48,961 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:48,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar	dst=null	perm=null
2013-10-31 18:28:48,992 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46386, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1585629740, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9189823900633492842_1032, duration: 1677371
2013-10-31 18:28:49,076 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0003_m_-1824933735
2013-10-31 18:28:49,083 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17001 with signal TERM. Exit code 0
2013-10-31 18:28:49,083 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_629524259
2013-10-31 18:28:49,084 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_629524259 spawned.
2013-10-31 18:28:49,088 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000007_0/taskjvm.sh
2013-10-31 18:28:49,192 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:49,192 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:49,193 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:49,193 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_-1824933735 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:49,350 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1264182116435781743_1027
2013-10-31 18:28:50,543 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_629524259 given task: attempt_20131031182606197_0004_m_000007_0
2013-10-31 18:28:50,891 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,891 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0003_m_000004_0 not found in cache
2013-10-31 18:28:50,891 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,892 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530891
2013-10-31 18:28:50,892 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530892
2013-10-31 18:28:50,892 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,892 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530892
2013-10-31 18:28:50,893 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,893 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530893
2013-10-31 18:28:51,057 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_r_1010257680 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,064 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17258 with signal TERM. Exit code 0
2013-10-31 18:28:51,078 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1264182116435781743_1027 file build/test/data/dfs/data/data2/current/blk_1264182116435781743 for deletion
2013-10-31 18:28:51,078 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1264182116435781743_1027 at file build/test/data/dfs/data/data2/current/blk_1264182116435781743
2013-10-31 18:28:51,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:51,151 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_259930158 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,161 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16839 with signal TERM. Exit code 0
2013-10-31 18:28:51,227 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,228 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,228 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:51,228 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_r_1010257680 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:51,288 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_606975538 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,298 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17052 with signal TERM. Exit code 0
2013-10-31 18:28:51,335 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,335 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,335 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:51,335 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_259930158 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:28:51,519 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,519 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,519 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:51,519 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_606975538 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:51,759 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_1908169258 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,769 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17096 with signal TERM. Exit code 0
2013-10-31 18:28:51,782 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_-594210753 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,792 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17095 with signal TERM. Exit code 0
2013-10-31 18:28:51,982 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,983 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,983 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:51,983 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_1908169258 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:51,984 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,985 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,985 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:28:51,985 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_-594210753 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:54,008 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000007_0 0.0% setup
2013-10-31 18:28:54,012 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000007_0 is done.
2013-10-31 18:28:54,013 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000007_0  was -1
2013-10-31 18:28:54,013 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:54,909 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000007_0' has completed task_20131031182606197_0004_m_000007 successfully.
2013-10-31 18:28:54,913 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000000_0' to tip task_20131031182606197_0004_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:54,915 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000000
2013-10-31 18:28:54,915 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000001_0' to tip task_20131031182606197_0004_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:54,916 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000001
2013-10-31 18:28:54,918 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000002_0' to tip task_20131031182606197_0004_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:28:54,921 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:28:54,922 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000002
2013-10-31 18:28:54,922 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:28:54,922 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000000_0 which needs 1 slots
2013-10-31 18:28:54,922 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000003_0' to tip task_20131031182606197_0004_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:28:54,923 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000000_0 which needs 1 slots
2013-10-31 18:28:54,923 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000003
2013-10-31 18:28:54,923 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000001_0 which needs 1 slots
2013-10-31 18:28:54,923 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0004_m_000001_0 which needs 1 slots
2013-10-31 18:28:54,931 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:28:54,933 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:28:54,933 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000002_0 which needs 1 slots
2013-10-31 18:28:54,934 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000002_0 which needs 1 slots
2013-10-31 18:28:54,934 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000003_0 which needs 1 slots
2013-10-31 18:28:54,935 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0004_m_000003_0 which needs 1 slots
2013-10-31 18:28:54,948 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000004_0' to tip task_20131031182606197_0004_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:28:54,949 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000004
2013-10-31 18:28:54,949 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000005_0' to tip task_20131031182606197_0004_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:28:54,950 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000005
2013-10-31 18:28:54,952 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:28:54,953 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:28:54,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000004_0 which needs 1 slots
2013-10-31 18:28:54,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000004_0 which needs 1 slots
2013-10-31 18:28:54,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000005_0 which needs 1 slots
2013-10-31 18:28:54,954 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0004_m_000005_0 which needs 1 slots
2013-10-31 18:28:54,970 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_1328977401
2013-10-31 18:28:54,972 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_1328977401 spawned.
2013-10-31 18:28:54,973 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0004/attempt_20131031182606197_0004_m_000001_0. Attempting to reuse: jvm_20131031182606197_0004_m_629524259
2013-10-31 18:28:54,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken	dst=null	perm=null
2013-10-31 18:28:54,976 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000000_0/taskjvm.sh
2013-10-31 18:28:54,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken	dst=null	perm=null
2013-10-31 18:28:54,979 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49302, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 248591
2013-10-31 18:28:54,981 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49303, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 351101
2013-10-31 18:28:54,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml	dst=null	perm=null
2013-10-31 18:28:54,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml	dst=null	perm=null
2013-10-31 18:28:54,993 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42503, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-1750631584, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4845321285802585100_1035, duration: 320577
2013-10-31 18:28:54,995 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49307, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-319264519, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4845321285802585100_1035, duration: 508724
2013-10-31 18:28:55,022 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:55,023 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:55,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar	dst=null	perm=null
2013-10-31 18:28:55,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar	dst=null	perm=null
2013-10-31 18:28:55,039 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49308, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-319264519, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9189823900633492842_1032, duration: 777078
2013-10-31 18:28:55,040 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46680, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1750631584, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9189823900633492842_1032, duration: 844269
2013-10-31 18:28:55,065 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_629524259 given task: attempt_20131031182606197_0004_m_000001_0
2013-10-31 18:28:55,103 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_-461648355
2013-10-31 18:28:55,104 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_-461648355 spawned.
2013-10-31 18:28:55,105 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_895495320
2013-10-31 18:28:55,106 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_895495320 spawned.
2013-10-31 18:28:55,106 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_103233333
2013-10-31 18:28:55,107 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_103233333 spawned.
2013-10-31 18:28:55,107 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_593026137
2013-10-31 18:28:55,107 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000004_0/taskjvm.sh
2013-10-31 18:28:55,108 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_593026137 spawned.
2013-10-31 18:28:55,109 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000005_0/taskjvm.sh
2013-10-31 18:28:55,110 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000002_0/taskjvm.sh
2013-10-31 18:28:55,110 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000003_0/taskjvm.sh
2013-10-31 18:28:55,808 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_1328977401 given task: attempt_20131031182606197_0004_m_000000_0
2013-10-31 18:28:56,000 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:28:56,006 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,012 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,056 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,063 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,068 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,074 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,074 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:28:56,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:56,337 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42509, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 200053
2013-10-31 18:28:56,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:28:56,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:56,525 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46685, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1962318321612106766_1033, duration: 218422
2013-10-31 18:28:56,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:28:56,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46686, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 174507
2013-10-31 18:28:56,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49316, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 157338
2013-10-31 18:28:57,238 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_-461648355 given task: attempt_20131031182606197_0004_m_000004_0
2013-10-31 18:28:57,288 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_103233333 given task: attempt_20131031182606197_0004_m_000002_0
2013-10-31 18:28:57,289 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_593026137 given task: attempt_20131031182606197_0004_m_000003_0
2013-10-31 18:28:57,293 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_895495320 given task: attempt_20131031182606197_0004_m_000005_0
2013-10-31 18:28:57,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:57,748 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46696, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000004_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1962318321612106766_1033, duration: 205338
2013-10-31 18:28:57,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:57,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:28:57,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:57,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 187830
2013-10-31 18:28:57,789 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42524, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 188095
2013-10-31 18:28:57,792 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49328, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1962318321612106766_1033, duration: 195804
2013-10-31 18:28:57,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split	dst=null	perm=null
2013-10-31 18:28:57,806 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42526, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000005_0, offset: 1536, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 224372
2013-10-31 18:28:57,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:28:57,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:28:57,834 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46418, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 151118
2013-10-31 18:28:57,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:28:57,846 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46702, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000005_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 179100
2013-10-31 18:28:58,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42529, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 192457
2013-10-31 18:28:59,269 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:28:59,275 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000000_0 is done.
2013-10-31 18:28:59,275 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000000_0  was 57
2013-10-31 18:28:59,275 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:28:59,490 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:28:59,493 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000001_0 is done.
2013-10-31 18:28:59,493 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000001_0  was 40
2013-10-31 18:28:59,494 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:59,922 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0004_m_000007_0
2013-10-31 18:28:59,923 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0004_m_000007_0
2013-10-31 18:28:59,923 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0004_m_000007_0 not found in cache
2013-10-31 18:29:00,676 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:29:00,677 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000004_0 is done.
2013-10-31 18:29:00,677 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000004_0  was 6
2013-10-31 18:29:00,678 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:29:00,715 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:29:00,717 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000002_0 is done.
2013-10-31 18:29:00,717 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000002_0  was 57
2013-10-31 18:29:00,718 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:29:00,720 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:29:00,722 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000003_0 is done.
2013-10-31 18:29:00,722 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000003_0  was 40
2013-10-31 18:29:00,722 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:00,733 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000005_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:29:00,734 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000005_0 is done.
2013-10-31 18:29:00,734 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000005_0  was 6
2013-10-31 18:29:00,734 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:00,926 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000000_0' has completed task_20131031182606197_0004_m_000000 successfully.
2013-10-31 18:29:00,929 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000001_0' has completed task_20131031182606197_0004_m_000001 successfully.
2013-10-31 18:29:00,932 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0004_r_000000_0' to tip task_20131031182606197_0004_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:00,935 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:29:00,935 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_r_000000_0 which needs 1 slots
2013-10-31 18:29:00,935 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_r_000000_0 which needs 1 slots
2013-10-31 18:29:00,936 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000002_0' has completed task_20131031182606197_0004_m_000002 successfully.
2013-10-31 18:29:00,941 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000003_0' has completed task_20131031182606197_0004_m_000003 successfully.
2013-10-31 18:29:00,959 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000004_0' has completed task_20131031182606197_0004_m_000004 successfully.
2013-10-31 18:29:00,961 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000005_0' has completed task_20131031182606197_0004_m_000005 successfully.
2013-10-31 18:29:00,979 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_r_1834196118
2013-10-31 18:29:00,980 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_r_1834196118 spawned.
2013-10-31 18:29:00,981 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_r_000000_0/taskjvm.sh
2013-10-31 18:29:02,122 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_r_1834196118 given task: attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:07,871 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48371, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000000_0, duration: 13690428
2013-10-31 18:29:08,586 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy > 
2013-10-31 18:29:08,997 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48371, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000001_0, duration: 13214072
2013-10-31 18:29:09,014 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40738, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000002_0, duration: 13122866
2013-10-31 18:29:09,030 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40738, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000003_0, duration: 11903053
2013-10-31 18:29:09,047 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38718, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000004_0, duration: 12396678
2013-10-31 18:29:09,062 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38718, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000005_0, duration: 11548678
2013-10-31 18:29:09,638 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy > 
2013-10-31 18:29:09,692 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy > 
2013-10-31 18:29:09,883 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 204 Total time for transactions(ms): 7Number of transactions batched in Syncs: 7 Number of syncs: 134 SyncTimes(ms): 20096 8980 
2013-10-31 18:29:09,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:09,943 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   6 OK for attempt_20131031182606197_0004_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:29:10,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:10,214 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000. blk_-1831368079888489988_1039
2013-10-31 18:29:10,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1831368079888489988_1039 src: /127.0.0.1:46709 dest: /127.0.0.1:54365
2013-10-31 18:29:10,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1831368079888489988_1039 src: /127.0.0.1:49339 dest: /127.0.0.1:34578
2013-10-31 18:29:10,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1831368079888489988_1039 src: /127.0.0.1:42537 dest: /127.0.0.1:59471
2013-10-31 18:29:10,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42537, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0004_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1831368079888489988_1039, duration: 2042528
2013-10-31 18:29:10,265 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1831368079888489988_1039 terminating
2013-10-31 18:29:10,266 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49339, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0004_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1831368079888489988_1039, duration: 3544566
2013-10-31 18:29:10,266 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1831368079888489988_1039 terminating
2013-10-31 18:29:10,267 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46709, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0004_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 4254561
2013-10-31 18:29:10,267 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1831368079888489988_1039 terminating
2013-10-31 18:29:10,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1831368079888489988_1039 size 40
2013-10-31 18:29:10,270 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1831368079888489988_1039 size 40
2013-10-31 18:29:10,270 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1831368079888489988_1039 size 40
2013-10-31 18:29:10,270 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:10,270 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:10,309 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0004_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:29:10,309 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy > 
2013-10-31 18:29:11,634 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:12,947 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:13,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0	dst=null	perm=null
2013-10-31 18:29:13,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:13,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:13,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0	dst=null	perm=null
2013-10-31 18:29:14,674 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:14,677 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:14,680 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_r_000000_0 is done.
2013-10-31 18:29:14,680 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_r_000000_0  was -1
2013-10-31 18:29:14,680 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:15,951 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_r_000000_0' has completed task_20131031182606197_0004_r_000000 successfully.
2013-10-31 18:29:16,133 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0004_m_000006_0' to tip task_20131031182606197_0004_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:16,135 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:29:16,136 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000006_0 which needs 1 slots
2013-10-31 18:29:16,136 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000006_0 which needs 1 slots
2013-10-31 18:29:16,176 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0004/attempt_20131031182606197_0004_m_000006_0. Attempting to reuse: jvm_20131031182606197_0004_m_1328977401
2013-10-31 18:29:16,351 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_1328977401 given task: attempt_20131031182606197_0004_m_000006_0
2013-10-31 18:29:16,510 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000006_0 0.0% 
2013-10-31 18:29:16,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary	dst=null	perm=null
2013-10-31 18:29:16,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:16,529 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_SUCCESS from client DFSClient_attempt_20131031182606197_0004_m_000006_0
2013-10-31 18:29:16,529 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0004_m_000006_0
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9217066690358023305 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9217066690358023305 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,535 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9217066690358023305 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,536 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4845321285802585100 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,536 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4845321285802585100 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,536 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4845321285802585100 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004	dst=null	perm=null
2013-10-31 18:29:16,656 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8976559195179578700_1001
2013-10-31 18:29:19,355 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-1962318321612106766_1033 blk_-9189823900633492842_1032 blk_9217066690358023305_1034 blk_4845321285802585100_1035
2013-10-31 18:29:19,355 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-1962318321612106766_1033 blk_-9189823900633492842_1032
2013-10-31 18:29:19,463 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000006_0 0.0% cleanup
2013-10-31 18:29:19,465 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000006_0 is done.
2013-10-31 18:29:19,466 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000006_0  was -1
2013-10-31 18:29:19,466 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:19,966 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data4/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:19,966 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data3/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:19,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data4/current/blk_-9189823900633492842
2013-10-31 18:29:19,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4845321285802585100_1035 file build/test/data/dfs/data/data3/current/blk_4845321285802585100 for deletion
2013-10-31 18:29:19,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data3/current/blk_-1962318321612106766
2013-10-31 18:29:19,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9217066690358023305_1034 file build/test/data/dfs/data/data4/current/blk_9217066690358023305 for deletion
2013-10-31 18:29:19,968 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4845321285802585100_1035 at file build/test/data/dfs/data/data3/current/blk_4845321285802585100
2013-10-31 18:29:19,968 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9217066690358023305_1034 at file build/test/data/dfs/data/data4/current/blk_9217066690358023305
2013-10-31 18:29:21,136 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:21,136 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:21,165 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data7/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:21,165 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data8/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:21,166 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data7/current/blk_-9189823900633492842
2013-10-31 18:29:21,166 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data8/current/blk_-1962318321612106766
2013-10-31 18:29:22,143 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000006_0' has completed task_20131031182606197_0004_m_000006 successfully.
2013-10-31 18:29:22,145 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0004 has completed successfully.
2013-10-31 18:29:22,146 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0004,submitTime=1383244127937,launchTime=1383244128449,firstMapTaskLaunchTime=1383244134913,firstReduceTaskLaunchTime=1383244140932,firstJobSetupTaskLaunchTime=1383244128895,firstJobCleanupTaskLaunchTime=1383244156133,finishTime=1383244162145,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=13,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[135A132A023E4325807DD05CD043A642/AC02971AC50B4DBF939A3656494373E4] merge/(1/1) ...pipesplatform/simplemerge
2013-10-31 18:29:22,152 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF. blk_4155904879908459364_1040
2013-10-31 18:29:22,158 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4155904879908459364_1040 src: /127.0.0.1:42541 dest: /127.0.0.1:59471
2013-10-31 18:29:22,161 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4155904879908459364_1040 src: /127.0.0.1:49345 dest: /127.0.0.1:34578
2013-10-31 18:29:22,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4155904879908459364_1040 src: /127.0.0.1:46717 dest: /127.0.0.1:54365
2013-10-31 18:29:22,173 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46717, dest: /127.0.0.1:54365, bytes: 34985, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4155904879908459364_1040, duration: 4236600
2013-10-31 18:29:22,174 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4155904879908459364_1040 terminating
2013-10-31 18:29:22,175 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49345, dest: /127.0.0.1:34578, bytes: 34985, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4155904879908459364_1040, duration: 8378818
2013-10-31 18:29:22,175 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4155904879908459364_1040 terminating
2013-10-31 18:29:22,177 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42541, dest: /127.0.0.1:59471, bytes: 34985, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4155904879908459364_1040, duration: 8191988
2013-10-31 18:29:22,177 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4155904879908459364_1040 size 34985
2013-10-31 18:29:22,177 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4155904879908459364_1040 terminating
2013-10-31 18:29:22,180 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4155904879908459364_1040 size 34985
2013-10-31 18:29:22,185 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF from client DFSClient_-1078423659
2013-10-31 18:29:22,185 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF is closed by DFSClient_-1078423659
2013-10-31 18:29:22,186 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4155904879908459364_1040 size 34985
2013-10-31 18:29:22,193 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:29:22,193 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000000_0'
2013-10-31 18:29:22,194 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000001_0'
2013-10-31 18:29:22,194 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000006_0'
2013-10-31 18:29:22,194 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000007_0'
2013-10-31 18:29:22,195 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_r_000000_0'
2013-10-31 18:29:22,195 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3563572431240499727 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:22,196 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3563572431240499727 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:22,196 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000002_0'
2013-10-31 18:29:22,196 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3563572431240499727 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:22,196 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000003_0'
2013-10-31 18:29:22,197 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000004_0'
2013-10-31 18:29:22,198 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000005_0'
2013-10-31 18:29:22,199 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:22,199 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0004 being deleted.
2013-10-31 18:29:22,201 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0004_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:29:22,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004	dst=null	perm=null
2013-10-31 18:29:22,206 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary
2013-10-31 18:29:22,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge	dst=null	perm=null
2013-10-31 18:29:22,230 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:29:22,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000	dst=null	perm=null
2013-10-31 18:29:22,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000	dst=null	perm=null
2013-10-31 18:29:22,236 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46719, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 310631
2013-10-31 18:29:22,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge	dst=null	perm=null
2013-10-31 18:29:22,256 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:29:22,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000	dst=null	perm=null
2013-10-31 18:29:22,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000	dst=null	perm=null
2013-10-31 18:29:22,260 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46720, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 318021
2013-10-31 18:29:22,260 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simplemerge
2013-10-31 18:29:22,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge	dst=null	perm=null
2013-10-31 18:29:22,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000	dst=null	perm=null
2013-10-31 18:29:22,267 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46721, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 315485
2013-10-31 18:29:22,356 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-1962318321612106766_1033 blk_-9189823900633492842_1032 blk_9217066690358023305_1034 blk_4845321285802585100_1035 blk_-3563572431240499727_1038
2013-10-31 18:29:22,356 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-3563572431240499727_1038
2013-10-31 18:29:22,383 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:29:22,383 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:29:22,401 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:29:22,401 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:29:22,401 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach"]
2013-10-31 18:29:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:29:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:29:22,402 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:29:22,403 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...edpipesplatform/chaineach
2013-10-31 18:29:22,409 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:29:22,409 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:29:22,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:22,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:29:22,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,432 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar. blk_1525934705393393935_1041
2013-10-31 18:29:22,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:49351 dest: /127.0.0.1:34578
2013-10-31 18:29:22,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:46723 dest: /127.0.0.1:54365
2013-10-31 18:29:22,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:46441 dest: /127.0.0.1:37740
2013-10-31 18:29:22,448 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46441, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1525934705393393935_1041, duration: 8389941
2013-10-31 18:29:22,449 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1525934705393393935_1041 terminating
2013-10-31 18:29:22,450 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:22,451 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46723, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1525934705393393935_1041, duration: 10375906
2013-10-31 18:29:22,451 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:22,451 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1525934705393393935_1041 terminating
2013-10-31 18:29:22,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49351, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1525934705393393935_1041, duration: 12645755
2013-10-31 18:29:22,453 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1525934705393393935_1041 terminating
2013-10-31 18:29:22,455 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:22,455 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar from client DFSClient_-1596270109
2013-10-31 18:29:22,455 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:29:22,461 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar. New replication is 10
2013-10-31 18:29:22,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=null
2013-10-31 18:29:22,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,471 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:29:22,477 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:29:22,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:29:22,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,490 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split. New replication is 10
2013-10-31 18:29:22,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=null
2013-10-31 18:29:22,497 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split. blk_3622021248328174299_1042
2013-10-31 18:29:22,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:46442 dest: /127.0.0.1:37740
2013-10-31 18:29:22,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:49355 dest: /127.0.0.1:34578
2013-10-31 18:29:22,502 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:46727 dest: /127.0.0.1:54365
2013-10-31 18:29:22,504 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:42554 dest: /127.0.0.1:59471
2013-10-31 18:29:22,508 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42554, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3622021248328174299_1042, duration: 1036100
2013-10-31 18:29:22,509 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,510 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46727, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3622021248328174299_1042, duration: 2503340
2013-10-31 18:29:22,510 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,511 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,512 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49355, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3622021248328174299_1042, duration: 4310238
2013-10-31 18:29:22,512 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,514 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46442, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3622021248328174299_1042, duration: 6324069
2013-10-31 18:29:22,514 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,514 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,516 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,516 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split from client DFSClient_-1596270109
2013-10-31 18:29:22,517 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split is closed by DFSClient_-1596270109
2013-10-31 18:29:22,517 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3563572431240499727_1038 file build/test/data/dfs/data/data3/current/blk_-3563572431240499727 for deletion
2013-10-31 18:29:22,967 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3563572431240499727_1038 at file build/test/data/dfs/data/data3/current/blk_-3563572431240499727
2013-10-31 18:29:23,679 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data5/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:23,679 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3563572431240499727_1038 file build/test/data/dfs/data/data6/current/blk_-3563572431240499727 for deletion
2013-10-31 18:29:23,679 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data5/current/blk_-9189823900633492842
2013-10-31 18:29:23,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data6/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:23,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3563572431240499727_1038 at file build/test/data/dfs/data/data6/current/blk_-3563572431240499727
2013-10-31 18:29:23,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4845321285802585100_1035 file build/test/data/dfs/data/data6/current/blk_4845321285802585100 for deletion
2013-10-31 18:29:23,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data6/current/blk_-1962318321612106766
2013-10-31 18:29:23,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9217066690358023305_1034 file build/test/data/dfs/data/data5/current/blk_9217066690358023305 for deletion
2013-10-31 18:29:23,680 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4845321285802585100_1035 at file build/test/data/dfs/data/data6/current/blk_4845321285802585100
2013-10-31 18:29:23,681 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9217066690358023305_1034 at file build/test/data/dfs/data/data5/current/blk_9217066690358023305
2013-10-31 18:29:25,357 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_1525934705393393935_1041 to datanode(s) 127.0.0.1:59471
2013-10-31 18:29:25,358 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-1962318321612106766_1033 blk_-9189823900633492842_1032 blk_9217066690358023305_1034 blk_4845321285802585100_1035 blk_-3563572431240499727_1038
2013-10-31 18:29:26,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,487 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo. blk_8654515203457545904_1043
2013-10-31 18:29:26,489 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8654515203457545904_1043 src: /127.0.0.1:46729 dest: /127.0.0.1:54365
2013-10-31 18:29:26,492 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8654515203457545904_1043 src: /127.0.0.1:46447 dest: /127.0.0.1:37740
2013-10-31 18:29:26,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8654515203457545904_1043 src: /127.0.0.1:49360 dest: /127.0.0.1:34578
2013-10-31 18:29:26,497 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49360, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8654515203457545904_1043, duration: 1355307
2013-10-31 18:29:26,498 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8654515203457545904_1043 terminating
2013-10-31 18:29:26,499 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46447, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8654515203457545904_1043, duration: 2581622
2013-10-31 18:29:26,499 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8654515203457545904_1043 terminating
2013-10-31 18:29:26,500 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8654515203457545904_1043 size 156
2013-10-31 18:29:26,501 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46729, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8654515203457545904_1043, duration: 4423848
2013-10-31 18:29:26,501 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8654515203457545904_1043 terminating
2013-10-31 18:29:26,504 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8654515203457545904_1043 size 156
2013-10-31 18:29:26,505 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:29:26,505 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:29:26,506 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8654515203457545904_1043 size 156
2013-10-31 18:29:26,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,534 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml. blk_937321463194479642_1044
2013-10-31 18:29:26,535 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_937321463194479642_1044 src: /127.0.0.1:42558 dest: /127.0.0.1:59471
2013-10-31 18:29:26,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_937321463194479642_1044 src: /127.0.0.1:46733 dest: /127.0.0.1:54365
2013-10-31 18:29:26,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_937321463194479642_1044 src: /127.0.0.1:46451 dest: /127.0.0.1:37740
2013-10-31 18:29:26,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46451, dest: /127.0.0.1:37740, bytes: 28492, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_937321463194479642_1044, duration: 1033243
2013-10-31 18:29:26,543 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_937321463194479642_1044 terminating
2013-10-31 18:29:26,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46733, dest: /127.0.0.1:54365, bytes: 28492, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_937321463194479642_1044, duration: 2808509
2013-10-31 18:29:26,545 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_937321463194479642_1044 terminating
2013-10-31 18:29:26,546 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42558, dest: /127.0.0.1:59471, bytes: 28492, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_937321463194479642_1044, duration: 4407726
2013-10-31 18:29:26,546 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_937321463194479642_1044 size 28492
2013-10-31 18:29:26,547 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_937321463194479642_1044 terminating
2013-10-31 18:29:26,548 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_937321463194479642_1044 size 28492
2013-10-31 18:29:26,549 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml from client DFSClient_-1596270109
2013-10-31 18:29:26,549 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:29:26,550 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_937321463194479642_1044 size 28492
2013-10-31 18:29:26,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=null
2013-10-31 18:29:26,567 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46736, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-79208835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_937321463194479642_1044, duration: 454286
2013-10-31 18:29:26,587 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0005: nMaps=4 nReduces=1 max=-1
2013-10-31 18:29:26,588 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0005 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:29:26,588 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0005
2013-10-31 18:29:26,588 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0005	RESULT=SUCCESS
2013-10-31 18:29:26,588 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0005
2013-10-31 18:29:26,590 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0005
2013-10-31 18:29:26,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,624 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml. blk_-4435351282615346343_1046
2013-10-31 18:29:26,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4435351282615346343_1046 src: /127.0.0.1:49366 dest: /127.0.0.1:34578
2013-10-31 18:29:26,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4435351282615346343_1046 src: /127.0.0.1:42564 dest: /127.0.0.1:59471
2013-10-31 18:29:26,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4435351282615346343_1046 src: /127.0.0.1:46456 dest: /127.0.0.1:37740
2013-10-31 18:29:26,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46456, dest: /127.0.0.1:37740, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4435351282615346343_1046, duration: 1271009
2013-10-31 18:29:26,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4435351282615346343_1046 terminating
2013-10-31 18:29:26,632 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42564, dest: /127.0.0.1:59471, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4435351282615346343_1046, duration: 1933318
2013-10-31 18:29:26,632 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4435351282615346343_1046 terminating
2013-10-31 18:29:26,633 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49366, dest: /127.0.0.1:34578, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4435351282615346343_1046, duration: 3224920
2013-10-31 18:29:26,634 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4435351282615346343_1046 terminating
2013-10-31 18:29:26,634 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4435351282615346343_1046 size 28557
2013-10-31 18:29:26,635 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml from client DFSClient_-79208835
2013-10-31 18:29:26,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml is closed by DFSClient_-79208835
2013-10-31 18:29:26,636 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4435351282615346343_1046 size 28557
2013-10-31 18:29:26,637 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4435351282615346343_1046 size 28557
2013-10-31 18:29:26,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,650 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken. blk_-2648717928242097379_1047
2013-10-31 18:29:26,652 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2648717928242097379_1047 src: /127.0.0.1:49369 dest: /127.0.0.1:34578
2013-10-31 18:29:26,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2648717928242097379_1047 src: /127.0.0.1:46458 dest: /127.0.0.1:37740
2013-10-31 18:29:26,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2648717928242097379_1047 src: /127.0.0.1:42568 dest: /127.0.0.1:59471
2013-10-31 18:29:26,659 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42568, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2648717928242097379_1047, duration: 1289811
2013-10-31 18:29:26,660 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2648717928242097379_1047 terminating
2013-10-31 18:29:26,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46458, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2648717928242097379_1047, duration: 2148703
2013-10-31 18:29:26,660 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2648717928242097379_1047 size 116
2013-10-31 18:29:26,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49369, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2648717928242097379_1047, duration: 2586089
2013-10-31 18:29:26,660 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2648717928242097379_1047 terminating
2013-10-31 18:29:26,661 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2648717928242097379_1047 terminating
2013-10-31 18:29:26,662 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2648717928242097379_1047 size 116
2013-10-31 18:29:26,663 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken from client DFSClient_-1596270109
2013-10-31 18:29:26,663 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:29:26,664 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2648717928242097379_1047 size 116
2013-10-31 18:29:26,672 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken
2013-10-31 18:29:26,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:29:26,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46743, bytes: 160, op: HDFS_READ, cliID: DFSClient_-79208835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8654515203457545904_1043, duration: 316074
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0005 = 1449. Number of splits = 4
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0005 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:29:26,677 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0005 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:29:27,091 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_1525934705393393935_1041 to 127.0.0.1:59471 
2013-10-31 18:29:27,091 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data1/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:27,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3563572431240499727_1038 file build/test/data/dfs/data/data2/current/blk_-3563572431240499727 for deletion
2013-10-31 18:29:27,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data1/current/blk_-9189823900633492842
2013-10-31 18:29:27,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3563572431240499727_1038 at file build/test/data/dfs/data/data2/current/blk_-3563572431240499727
2013-10-31 18:29:27,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data2/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:27,093 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:42570 dest: /127.0.0.1:59471
2013-10-31 18:29:27,093 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_1525934705393393935_1041 to /127.0.0.1:59471
2013-10-31 18:29:27,093 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4845321285802585100_1035 file build/test/data/dfs/data/data2/current/blk_4845321285802585100 for deletion
2013-10-31 18:29:27,093 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data2/current/blk_-1962318321612106766
2013-10-31 18:29:27,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9217066690358023305_1034 file build/test/data/dfs/data/data1/current/blk_9217066690358023305 for deletion
2013-10-31 18:29:27,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4845321285802585100_1035 at file build/test/data/dfs/data/data2/current/blk_4845321285802585100
2013-10-31 18:29:27,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9217066690358023305_1034 at file build/test/data/dfs/data/data1/current/blk_9217066690358023305
2013-10-31 18:29:27,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1525934705393393935_1041 src: /127.0.0.1:42570 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:29:27,099 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:27,196 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:27,198 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:27,198 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0004_m_000006_0 not found in cache
2013-10-31 18:29:27,199 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:27,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383330567199
2013-10-31 18:29:27,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383330567199
2013-10-31 18:29:27,199 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383330567199
2013-10-31 18:29:27,222 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_r_1834196118 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:27,232 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17989 with signal TERM. Exit code 0
2013-10-31 18:29:27,396 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:27,396 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:27,396 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:29:27,396 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_r_1834196118 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:27,505 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_1328977401 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:27,516 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17637 with signal TERM. Exit code 0
2013-10-31 18:29:27,698 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:27,698 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:27,699 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:29:27,700 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_1328977401 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:29:28,204 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0005_m_000005_0' to tip task_20131031182606197_0005_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:28,212 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:29:28,212 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000005_0 which needs 1 slots
2013-10-31 18:29:28,212 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000005_0 which needs 1 slots
2013-10-31 18:29:28,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken	dst=null	perm=null
2013-10-31 18:29:28,222 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46462, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2648717928242097379_1047, duration: 352020
2013-10-31 18:29:28,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=null
2013-10-31 18:29:28,234 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46464, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-776293736, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_937321463194479642_1044, duration: 440111
2013-10-31 18:29:28,257 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_-461648355 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,263 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17729 with signal TERM. Exit code 0
2013-10-31 18:29:28,265 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:28,286 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_103233333 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,295 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17764 with signal TERM. Exit code 0
2013-10-31 18:29:28,296 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_593026137 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=null
2013-10-31 18:29:28,303 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_895495320 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,305 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17763 with signal TERM. Exit code 0
2013-10-31 18:29:28,310 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49377, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-776293736, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1525934705393393935_1041, duration: 1982768
2013-10-31 18:29:28,311 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17762 with signal TERM. Exit code 0
2013-10-31 18:29:28,374 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-2042360792
2013-10-31 18:29:28,375 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-2042360792 spawned.
2013-10-31 18:29:28,376 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000005_0/taskjvm.sh
2013-10-31 18:29:28,479 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,479 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,479 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:29:28,480 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_-461648355 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:28,502 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,502 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,502 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:29:28,503 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_103233333 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:28,513 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_895495320 exited with exit code 0. Number of tasks it ran: 1
2013-10-31 18:29:28,544 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,544 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,544 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:29:28,545 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_593026137 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:28,557 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_629524259 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,565 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17488 with signal TERM. Exit code 0
2013-10-31 18:29:28,760 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,761 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,761 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:29:28,761 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_629524259 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:29:30,255 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-2042360792 given task: attempt_20131031182606197_0005_m_000005_0
2013-10-31 18:29:30,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:33,711 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000005_0 0.0% setup
2013-10-31 18:29:33,714 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000005_0 is done.
2013-10-31 18:29:33,714 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000005_0  was -1
2013-10-31 18:29:33,715 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:33,951 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8976559195179578700_1001
2013-10-31 18:29:34,219 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000005_0' has completed task_20131031182606197_0005_m_000005 successfully.
2013-10-31 18:29:34,224 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000000_0' to tip task_20131031182606197_0005_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:34,225 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000000
2013-10-31 18:29:34,227 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:29:34,229 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000000_0 which needs 1 slots
2013-10-31 18:29:34,229 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000001_0' to tip task_20131031182606197_0005_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:29:34,229 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000000_0 which needs 1 slots
2013-10-31 18:29:34,231 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000001
2013-10-31 18:29:34,236 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:29:34,237 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000001_0 which needs 1 slots
2013-10-31 18:29:34,237 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000001_0 which needs 1 slots
2013-10-31 18:29:34,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken	dst=null	perm=null
2013-10-31 18:29:34,255 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42580, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2648717928242097379_1047, duration: 387556
2013-10-31 18:29:34,256 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000002_0' to tip task_20131031182606197_0005_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:29:34,257 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000002
2013-10-31 18:29:34,259 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:29:34,259 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000003_0' to tip task_20131031182606197_0005_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:29:34,259 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000002_0 which needs 1 slots
2013-10-31 18:29:34,259 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000002_0 which needs 1 slots
2013-10-31 18:29:34,260 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000003
2013-10-31 18:29:34,261 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:29:34,262 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000003_0 which needs 1 slots
2013-10-31 18:29:34,262 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000003_0 which needs 1 slots
2013-10-31 18:29:34,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=null
2013-10-31 18:29:34,265 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-739234499
2013-10-31 18:29:34,266 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-739234499 spawned.
2013-10-31 18:29:34,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46473, bytes: 28716, op: HDFS_READ, cliID: DFSClient_492599419, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_937321463194479642_1044, duration: 450963
2013-10-31 18:29:34,268 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000000_0/taskjvm.sh
2013-10-31 18:29:34,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken	dst=null	perm=null
2013-10-31 18:29:34,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken	dst=null	perm=null
2013-10-31 18:29:34,272 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46474, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2648717928242097379_1047, duration: 334997
2013-10-31 18:29:34,273 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42584, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2648717928242097379_1047, duration: 150892
2013-10-31 18:29:34,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=null
2013-10-31 18:29:34,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml	dst=null	perm=null
2013-10-31 18:29:34,279 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42587, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-514628270, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_937321463194479642_1044, duration: 191808
2013-10-31 18:29:34,279 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46762, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-2110195412, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_937321463194479642_1044, duration: 193623
2013-10-31 18:29:34,293 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:34,293 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:34,309 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:34,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=null
2013-10-31 18:29:34,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=null
2013-10-31 18:29:34,312 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46480, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-514628270, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1525934705393393935_1041, duration: 796343
2013-10-31 18:29:34,312 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46481, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2110195412, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1525934705393393935_1041, duration: 781802
2013-10-31 18:29:34,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar	dst=null	perm=null
2013-10-31 18:29:34,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46765, bytes: 239915, op: HDFS_READ, cliID: DFSClient_492599419, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1525934705393393935_1041, duration: 1666072
2013-10-31 18:29:34,453 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-378893990
2013-10-31 18:29:34,453 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-378893990 spawned.
2013-10-31 18:29:34,455 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000001_0/taskjvm.sh
2013-10-31 18:29:34,477 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-908586741
2013-10-31 18:29:34,478 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-908586741 spawned.
2013-10-31 18:29:34,479 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000002_0/taskjvm.sh
2013-10-31 18:29:34,482 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_723542760
2013-10-31 18:29:34,483 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_723542760 spawned.
2013-10-31 18:29:34,484 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000003_0/taskjvm.sh
2013-10-31 18:29:35,199 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-739234499 given task: attempt_20131031182606197_0005_m_000000_0
2013-10-31 18:29:35,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=null
2013-10-31 18:29:35,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42594, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3622021248328174299_1042, duration: 205708
2013-10-31 18:29:35,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:29:35,750 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49398, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 277458
2013-10-31 18:29:38,641 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:29:38,645 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000000_0 is done.
2013-10-31 18:29:38,645 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000000_0  was 54
2013-10-31 18:29:38,645 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:39,229 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0005_m_000005_0
2013-10-31 18:29:39,229 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0005_m_000005_0
2013-10-31 18:29:39,230 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0005_m_000005_0 not found in cache
2013-10-31 18:29:40,232 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000000_0' has completed task_20131031182606197_0005_m_000000 successfully.
2013-10-31 18:29:40,234 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0005_r_000000_0' to tip task_20131031182606197_0005_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:40,234 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:29:40,235 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_r_000000_0 which needs 1 slots
2013-10-31 18:29:40,235 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_r_000000_0 which needs 1 slots
2013-10-31 18:29:40,251 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_r_259930158
2013-10-31 18:29:40,252 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_r_259930158 spawned.
2013-10-31 18:29:40,254 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_r_000000_0/taskjvm.sh
2013-10-31 18:29:40,671 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-378893990 given task: attempt_20131031182606197_0005_m_000001_0
2013-10-31 18:29:40,817 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-908586741 given task: attempt_20131031182606197_0005_m_000002_0
2013-10-31 18:29:40,822 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_723542760 given task: attempt_20131031182606197_0005_m_000003_0
2013-10-31 18:29:41,163 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_r_259930158 given task: attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:41,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=null
2013-10-31 18:29:41,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42601, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3622021248328174299_1042, duration: 209985
2013-10-31 18:29:41,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:29:41,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=null
2013-10-31 18:29:41,320 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46495, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3622021248328174299_1042, duration: 185663
2013-10-31 18:29:41,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split	dst=null	perm=null
2013-10-31 18:29:41,327 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46496, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3622021248328174299_1042, duration: 115068
2013-10-31 18:29:41,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:29:41,360 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46497, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 205950
2013-10-31 18:29:41,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:29:41,367 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46781, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 172208
2013-10-31 18:29:41,539 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49411, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 185947
2013-10-31 18:29:44,106 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:29:44,110 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000001_0 is done.
2013-10-31 18:29:44,110 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000001_0  was 74
2013-10-31 18:29:44,111 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:44,250 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:29:44,253 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000002_0 is done.
2013-10-31 18:29:44,253 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000002_0  was 73
2013-10-31 18:29:44,253 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:44,258 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:29:44,261 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000003_0 is done.
2013-10-31 18:29:44,261 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000003_0  was 53
2013-10-31 18:29:44,261 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:46,244 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000001_0' has completed task_20131031182606197_0005_m_000001 successfully.
2013-10-31 18:29:46,269 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000002_0' has completed task_20131031182606197_0005_m_000002 successfully.
2013-10-31 18:29:46,274 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000003_0' has completed task_20131031182606197_0005_m_000003 successfully.
2013-10-31 18:29:46,825 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48450, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000000_0, duration: 8245714
2013-10-31 18:29:47,644 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:29:49,243 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:29:50,678 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:29:51,857 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40817, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000001_0, duration: 16777369
2013-10-31 18:29:51,875 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38797, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000002_0, duration: 12918945
2013-10-31 18:29:51,894 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43495, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000003_0, duration: 14167513
2013-10-31 18:29:52,697 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:29:52,770 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:29:53,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:53,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:53,205 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000. blk_3433002929109606464_1048
2013-10-31 18:29:53,249 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3433002929109606464_1048 src: /127.0.0.1:46507 dest: /127.0.0.1:37740
2013-10-31 18:29:53,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3433002929109606464_1048 src: /127.0.0.1:42617 dest: /127.0.0.1:59471
2013-10-31 18:29:53,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3433002929109606464_1048 src: /127.0.0.1:46792 dest: /127.0.0.1:54365
2013-10-31 18:29:53,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46792, dest: /127.0.0.1:54365, bytes: 160, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0005_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3433002929109606464_1048, duration: 2392662
2013-10-31 18:29:53,255 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3433002929109606464_1048 terminating
2013-10-31 18:29:53,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42617, dest: /127.0.0.1:59471, bytes: 160, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0005_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3433002929109606464_1048, duration: 3034094
2013-10-31 18:29:53,256 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3433002929109606464_1048 terminating
2013-10-31 18:29:53,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46507, dest: /127.0.0.1:37740, bytes: 160, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0005_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3433002929109606464_1048, duration: 4018870
2013-10-31 18:29:53,257 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3433002929109606464_1048 terminating
2013-10-31 18:29:53,258 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3433002929109606464_1048 size 160
2013-10-31 18:29:53,258 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3433002929109606464_1048 size 160
2013-10-31 18:29:53,259 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3433002929109606464_1048 size 160
2013-10-31 18:29:53,259 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:53,259 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:53,295 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0005_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:29:53,295 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:29:54,100 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:29:54,101 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:29:55,251 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   3 OK for attempt_20131031182606197_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:29:55,252 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:55,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0	dst=null	perm=null
2013-10-31 18:29:55,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:56,004 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 57
2013-10-31 18:29:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:29:56,018 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,046 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:29:56,731 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:56,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:56,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0	dst=null	perm=null
2013-10-31 18:29:57,099 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:29:57,102 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:34578, blocks: 16, processing time: 2 msecs
2013-10-31 18:29:57,102 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 16 blocks took 0 msec to generate and 3 msecs for RPC and NN processing
2013-10-31 18:29:59,773 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:59,776 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:59,777 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_r_000000_0 is done.
2013-10-31 18:29:59,777 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_r_000000_0  was -1
2013-10-31 18:29:59,778 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:01,260 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_r_000000_0' has completed task_20131031182606197_0005_r_000000 successfully.
2013-10-31 18:30:01,266 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0005_m_000004_0' to tip task_20131031182606197_0005_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:01,268 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:30:01,268 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000004_0 which needs 1 slots
2013-10-31 18:30:01,268 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000004_0 which needs 1 slots
2013-10-31 18:30:01,302 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0005/attempt_20131031182606197_0005_m_000004_0. Attempting to reuse: jvm_20131031182606197_0005_m_-2042360792
2013-10-31 18:30:01,848 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-2042360792 given task: attempt_20131031182606197_0005_m_000004_0
2013-10-31 18:30:01,987 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000004_0 0.0% 
2013-10-31 18:30:01,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary	dst=null	perm=null
2013-10-31 18:30:02,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:02,013 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_SUCCESS from client DFSClient_attempt_20131031182606197_0005_m_000004_0
2013-10-31 18:30:02,013 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0005_m_000004_0
2013-10-31 18:30:02,019 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:02,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:02,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:02,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8654515203457545904 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8654515203457545904 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8654515203457545904 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_937321463194479642 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_937321463194479642 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,021 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_937321463194479642 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:02,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005	dst=null	perm=null
2013-10-31 18:30:04,364 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_937321463194479642_1044 blk_1525934705393393935_1041 blk_8654515203457545904_1043 blk_3622021248328174299_1042
2013-10-31 18:30:04,364 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_937321463194479642_1044 blk_1525934705393393935_1041 blk_3622021248328174299_1042
2013-10-31 18:30:04,956 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000004_0 0.0% cleanup
2013-10-31 18:30:04,959 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000004_0 is done.
2013-10-31 18:30:04,959 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000004_0  was -1
2013-10-31 18:30:04,959 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:04,981 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_937321463194479642_1044 file build/test/data/dfs/data/data3/current/blk_937321463194479642 for deletion
2013-10-31 18:30:04,981 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data4/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:04,981 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_937321463194479642_1044 at file build/test/data/dfs/data/data3/current/blk_937321463194479642
2013-10-31 18:30:04,982 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data3/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:04,982 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data4/current/blk_1525934705393393935
2013-10-31 18:30:04,982 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8654515203457545904_1043 file build/test/data/dfs/data/data4/current/blk_8654515203457545904 for deletion
2013-10-31 18:30:04,982 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data3/current/blk_3622021248328174299
2013-10-31 18:30:04,983 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8654515203457545904_1043 at file build/test/data/dfs/data/data4/current/blk_8654515203457545904
2013-10-31 18:30:05,693 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_937321463194479642_1044 file build/test/data/dfs/data/data6/current/blk_937321463194479642 for deletion
2013-10-31 18:30:05,693 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data5/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:05,693 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_937321463194479642_1044 at file build/test/data/dfs/data/data6/current/blk_937321463194479642
2013-10-31 18:30:05,694 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data5/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:05,694 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data5/current/blk_1525934705393393935
2013-10-31 18:30:05,695 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data5/current/blk_3622021248328174299
2013-10-31 18:30:06,268 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:30:06,268 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:30:07,276 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000004_0' has completed task_20131031182606197_0005_m_000004 successfully.
2013-10-31 18:30:07,279 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0005 has completed successfully.
2013-10-31 18:30:07,279 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0005,submitTime=1383244166556,launchTime=1383244166677,firstMapTaskLaunchTime=1383244174224,firstReduceTaskLaunchTime=1383244180233,firstJobSetupTaskLaunchTime=1383244168204,firstJobCleanupTaskLaunchTime=1383244201265,finishTime=1383244207279,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=42,reduceSlotsSeconds=19,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[F2E50B34FDA34706A90056D38CB54A5E/6010D75D4AE04CA59A4AF372B35EE05F] test/(1/1) ...edpipesplatform/chaineach
2013-10-31 18:30:07,289 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5. blk_4501780269679559994_1049
2013-10-31 18:30:07,290 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501780269679559994_1049 src: /127.0.0.1:46516 dest: /127.0.0.1:37740
2013-10-31 18:30:07,293 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501780269679559994_1049 src: /127.0.0.1:46800 dest: /127.0.0.1:54365
2013-10-31 18:30:07,295 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501780269679559994_1049 src: /127.0.0.1:49430 dest: /127.0.0.1:34578
2013-10-31 18:30:07,306 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49430, dest: /127.0.0.1:34578, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4501780269679559994_1049, duration: 7507825
2013-10-31 18:30:07,307 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4501780269679559994_1049 terminating
2013-10-31 18:30:07,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46800, dest: /127.0.0.1:54365, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501780269679559994_1049, duration: 6901847
2013-10-31 18:30:07,308 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4501780269679559994_1049 terminating
2013-10-31 18:30:07,309 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46516, dest: /127.0.0.1:37740, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4501780269679559994_1049, duration: 7657180
2013-10-31 18:30:07,310 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4501780269679559994_1049 size 28302
2013-10-31 18:30:07,310 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4501780269679559994_1049 terminating
2013-10-31 18:30:07,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4501780269679559994_1049 size 28302
2013-10-31 18:30:07,315 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 from client DFSClient_-79208835
2013-10-31 18:30:07,315 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 is closed by DFSClient_-79208835
2013-10-31 18:30:07,316 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4501780269679559994_1049 size 28302
2013-10-31 18:30:07,365 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1525934705393393935_1041 blk_8654515203457545904_1043 blk_3622021248328174299_1042
2013-10-31 18:30:07,365 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_937321463194479642_1044 blk_1525934705393393935_1041 blk_8654515203457545904_1043 blk_3622021248328174299_1042
2013-10-31 18:30:07,533 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:07,534 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000000_0'
2013-10-31 18:30:07,534 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000004_0'
2013-10-31 18:30:07,534 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000005_0'
2013-10-31 18:30:07,535 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_r_000000_0'
2013-10-31 18:30:07,536 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2648717928242097379 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:07,536 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000003_0'
2013-10-31 18:30:07,536 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2648717928242097379 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:07,537 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2648717928242097379 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:07,537 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000002_0'
2013-10-31 18:30:07,538 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000001_0'
2013-10-31 18:30:07,541 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0005_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:07,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005	dst=null	perm=null
2013-10-31 18:30:07,545 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary
2013-10-31 18:30:07,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach	dst=null	perm=null
2013-10-31 18:30:07,561 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:07,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000	dst=null	perm=null
2013-10-31 18:30:07,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000	dst=null	perm=null
2013-10-31 18:30:07,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46803, bytes: 164, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3433002929109606464_1048, duration: 141156
2013-10-31 18:30:07,565 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chaineach
2013-10-31 18:30:07,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach	dst=null	perm=null
2013-10-31 18:30:07,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000	dst=null	perm=null
2013-10-31 18:30:07,571 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42630, bytes: 164, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3433002929109606464_1048, duration: 113951
2013-10-31 18:30:07,580 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:30:07,581 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:30:07,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:30:07,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:30:07,596 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator"]
2013-10-31 18:30:07,597 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:30:07,597 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:30:07,597 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:30:07,597 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...tform/generatoraggregator
2013-10-31 18:30:07,600 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:30:07,600 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:30:07,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:07,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:30:07,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,615 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar. blk_3900087759881409316_1050
2013-10-31 18:30:07,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:46522 dest: /127.0.0.1:37740
2013-10-31 18:30:07,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:49435 dest: /127.0.0.1:34578
2013-10-31 18:30:07,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:46807 dest: /127.0.0.1:54365
2013-10-31 18:30:07,629 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46807, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3900087759881409316_1050, duration: 7178590
2013-10-31 18:30:07,629 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3900087759881409316_1050 terminating
2013-10-31 18:30:07,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49435, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3900087759881409316_1050, duration: 8586537
2013-10-31 18:30:07,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3900087759881409316_1050 terminating
2013-10-31 18:30:07,632 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46522, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3900087759881409316_1050, duration: 11125658
2013-10-31 18:30:07,632 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3900087759881409316_1050 terminating
2013-10-31 18:30:07,632 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:07,635 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar from client DFSClient_-1596270109
2013-10-31 18:30:07,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:30:07,635 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:07,635 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:07,639 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar. New replication is 10
2013-10-31 18:30:07,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=null
2013-10-31 18:30:07,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,649 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:30:07,655 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:07,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:30:07,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,667 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split. New replication is 10
2013-10-31 18:30:07,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=null
2013-10-31 18:30:07,674 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split. blk_2287880348402893959_1051
2013-10-31 18:30:07,675 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:46525 dest: /127.0.0.1:37740
2013-10-31 18:30:07,676 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:42635 dest: /127.0.0.1:59471
2013-10-31 18:30:07,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:46810 dest: /127.0.0.1:54365
2013-10-31 18:30:07,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:49440 dest: /127.0.0.1:34578
2013-10-31 18:30:07,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49440, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2287880348402893959_1051, duration: 1951103
2013-10-31 18:30:07,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46810, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2287880348402893959_1051, duration: 1722221
2013-10-31 18:30:07,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,685 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,687 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,741 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42635, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2287880348402893959_1051, duration: 3159913
2013-10-31 18:30:07,741 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,742 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46525, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2287880348402893959_1051, duration: 59724856
2013-10-31 18:30:07,742 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,743 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,744 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split from client DFSClient_-1596270109
2013-10-31 18:30:07,745 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split is closed by DFSClient_-1596270109
2013-10-31 18:30:07,747 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,762 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo. blk_-1936656076941190583_1052
2013-10-31 18:30:07,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1936656076941190583_1052 src: /127.0.0.1:49441 dest: /127.0.0.1:34578
2013-10-31 18:30:07,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1936656076941190583_1052 src: /127.0.0.1:46530 dest: /127.0.0.1:37740
2013-10-31 18:30:07,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1936656076941190583_1052 src: /127.0.0.1:46814 dest: /127.0.0.1:54365
2013-10-31 18:30:07,767 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46814, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1936656076941190583_1052, duration: 386738
2013-10-31 18:30:07,767 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1936656076941190583_1052 terminating
2013-10-31 18:30:07,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46530, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1936656076941190583_1052, duration: 1714292
2013-10-31 18:30:07,768 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1936656076941190583_1052 terminating
2013-10-31 18:30:07,769 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49441, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1936656076941190583_1052, duration: 2921127
2013-10-31 18:30:07,769 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1936656076941190583_1052 size 156
2013-10-31 18:30:07,769 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1936656076941190583_1052 terminating
2013-10-31 18:30:07,770 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:30:07,771 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:30:07,771 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1936656076941190583_1052 size 156
2013-10-31 18:30:07,772 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1936656076941190583_1052 size 156
2013-10-31 18:30:09,107 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data1/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:09,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data2/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:09,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8654515203457545904_1043 file build/test/data/dfs/data/data1/current/blk_8654515203457545904 for deletion
2013-10-31 18:30:09,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data1/current/blk_1525934705393393935
2013-10-31 18:30:09,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data2/current/blk_3622021248328174299
2013-10-31 18:30:09,108 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8654515203457545904_1043 at file build/test/data/dfs/data/data1/current/blk_8654515203457545904
2013-10-31 18:30:09,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_937321463194479642_1044 file build/test/data/dfs/data/data7/current/blk_937321463194479642 for deletion
2013-10-31 18:30:09,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data8/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:09,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data7/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:09,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8654515203457545904_1043 file build/test/data/dfs/data/data8/current/blk_8654515203457545904 for deletion
2013-10-31 18:30:09,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data8/current/blk_1525934705393393935
2013-10-31 18:30:09,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_937321463194479642_1044 at file build/test/data/dfs/data/data7/current/blk_937321463194479642
2013-10-31 18:30:09,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8654515203457545904_1043 at file build/test/data/dfs/data/data8/current/blk_8654515203457545904
2013-10-31 18:30:09,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data7/current/blk_3622021248328174299
2013-10-31 18:30:10,366 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_3900087759881409316_1050 to datanode(s) 127.0.0.1:59471
2013-10-31 18:30:10,366 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-2648717928242097379_1047
2013-10-31 18:30:10,366 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-2648717928242097379_1047
2013-10-31 18:30:10,657 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 280 Total time for transactions(ms): 8Number of transactions batched in Syncs: 11 Number of syncs: 191 SyncTimes(ms): 28762 9436 
2013-10-31 18:30:10,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,678 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml. blk_-2472956342887107208_1053
2013-10-31 18:30:10,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2472956342887107208_1053 src: /127.0.0.1:49446 dest: /127.0.0.1:34578
2013-10-31 18:30:10,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2472956342887107208_1053 src: /127.0.0.1:46535 dest: /127.0.0.1:37740
2013-10-31 18:30:10,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2472956342887107208_1053 src: /127.0.0.1:42645 dest: /127.0.0.1:59471
2013-10-31 18:30:10,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42645, dest: /127.0.0.1:59471, bytes: 28318, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2472956342887107208_1053, duration: 1039614
2013-10-31 18:30:10,688 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2472956342887107208_1053 terminating
2013-10-31 18:30:10,690 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46535, dest: /127.0.0.1:37740, bytes: 28318, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 2533766
2013-10-31 18:30:10,690 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2472956342887107208_1053 terminating
2013-10-31 18:30:10,691 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2472956342887107208_1053 size 28318
2013-10-31 18:30:10,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49446, dest: /127.0.0.1:34578, bytes: 28318, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2472956342887107208_1053, duration: 4444030
2013-10-31 18:30:10,692 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2472956342887107208_1053 size 28318
2013-10-31 18:30:10,692 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2472956342887107208_1053 terminating
2013-10-31 18:30:10,694 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml from client DFSClient_-1596270109
2013-10-31 18:30:10,695 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:30:10,695 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2472956342887107208_1053 size 28318
2013-10-31 18:30:10,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=null
2013-10-31 18:30:10,711 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42647, bytes: 28542, op: HDFS_READ, cliID: DFSClient_592994435, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2472956342887107208_1053, duration: 474426
2013-10-31 18:30:10,730 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0006: nMaps=4 nReduces=1 max=-1
2013-10-31 18:30:10,731 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0006 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:30:10,731 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0006
2013-10-31 18:30:10,731 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0006	RESULT=SUCCESS
2013-10-31 18:30:10,731 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0006
2013-10-31 18:30:10,733 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0006
2013-10-31 18:30:10,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,770 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml. blk_-3726674750765888319_1055
2013-10-31 18:30:10,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3726674750765888319_1055 src: /127.0.0.1:46539 dest: /127.0.0.1:37740
2013-10-31 18:30:10,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3726674750765888319_1055 src: /127.0.0.1:49452 dest: /127.0.0.1:34578
2013-10-31 18:30:10,775 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3726674750765888319_1055 src: /127.0.0.1:46824 dest: /127.0.0.1:54365
2013-10-31 18:30:10,783 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46824, dest: /127.0.0.1:54365, bytes: 28383, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3726674750765888319_1055, duration: 4753535
2013-10-31 18:30:10,783 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3726674750765888319_1055 terminating
2013-10-31 18:30:10,784 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49452, dest: /127.0.0.1:34578, bytes: 28383, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3726674750765888319_1055, duration: 5543458
2013-10-31 18:30:10,784 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3726674750765888319_1055 terminating
2013-10-31 18:30:10,785 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46539, dest: /127.0.0.1:37740, bytes: 28383, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3726674750765888319_1055, duration: 6410008
2013-10-31 18:30:10,785 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3726674750765888319_1055 terminating
2013-10-31 18:30:10,787 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3726674750765888319_1055 size 28383
2013-10-31 18:30:10,787 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml from client DFSClient_592994435
2013-10-31 18:30:10,788 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml is closed by DFSClient_592994435
2013-10-31 18:30:10,788 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3726674750765888319_1055 size 28383
2013-10-31 18:30:10,789 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3726674750765888319_1055 size 28383
2013-10-31 18:30:10,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,801 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken. blk_1426554221262928588_1056
2013-10-31 18:30:10,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1426554221262928588_1056 src: /127.0.0.1:42651 dest: /127.0.0.1:59471
2013-10-31 18:30:10,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1426554221262928588_1056 src: /127.0.0.1:46826 dest: /127.0.0.1:54365
2013-10-31 18:30:10,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1426554221262928588_1056 src: /127.0.0.1:49456 dest: /127.0.0.1:34578
2013-10-31 18:30:10,810 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49456, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1426554221262928588_1056, duration: 1284876
2013-10-31 18:30:10,811 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1426554221262928588_1056 terminating
2013-10-31 18:30:10,812 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46826, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1426554221262928588_1056, duration: 2959070
2013-10-31 18:30:10,812 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1426554221262928588_1056 terminating
2013-10-31 18:30:10,812 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1426554221262928588_1056 size 116
2013-10-31 18:30:10,814 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42651, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1426554221262928588_1056, duration: 4846046
2013-10-31 18:30:10,814 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1426554221262928588_1056 terminating
2013-10-31 18:30:10,817 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1426554221262928588_1056 size 116
2013-10-31 18:30:10,817 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken from client DFSClient_-1596270109
2013-10-31 18:30:10,818 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:30:10,818 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1426554221262928588_1056 size 116
2013-10-31 18:30:10,821 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken
2013-10-31 18:30:10,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:30:10,825 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49457, bytes: 160, op: HDFS_READ, cliID: DFSClient_592994435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1936656076941190583_1052, duration: 296264
2013-10-31 18:30:10,827 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0006 = 1449. Number of splits = 4
2013-10-31 18:30:10,827 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,827 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0006 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:30:10,831 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0006 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:30:10,982 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_3900087759881409316_1050 to 127.0.0.1:59471 
2013-10-31 18:30:10,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:42655 dest: /127.0.0.1:59471
2013-10-31 18:30:10,985 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_3900087759881409316_1050 to /127.0.0.1:59471
2013-10-31 18:30:10,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3900087759881409316_1050 src: /127.0.0.1:42655 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:30:10,991 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:11,695 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2648717928242097379_1047 file build/test/data/dfs/data/data6/current/blk_-2648717928242097379 for deletion
2013-10-31 18:30:11,695 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2648717928242097379_1047 at file build/test/data/dfs/data/data6/current/blk_-2648717928242097379
2013-10-31 18:30:12,182 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2648717928242097379_1047 file build/test/data/dfs/data/data7/current/blk_-2648717928242097379 for deletion
2013-10-31 18:30:12,182 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2648717928242097379_1047 at file build/test/data/dfs/data/data7/current/blk_-2648717928242097379
2013-10-31 18:30:12,536 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,536 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0005_m_000004_0 not found in cache
2013-10-31 18:30:12,537 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612537
2013-10-31 18:30:12,537 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612537
2013-10-31 18:30:12,538 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,538 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612539
2013-10-31 18:30:12,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612539
2013-10-31 18:30:12,996 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-2042360792 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,007 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18300 with signal TERM. Exit code 0
2013-10-31 18:30:13,204 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-378893990 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,206 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,206 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,206 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:13,206 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-2042360792 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:30:13,214 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18490 with signal TERM. Exit code 0
2013-10-31 18:30:13,332 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-908586741 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,337 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18525 with signal TERM. Exit code 0
2013-10-31 18:30:13,347 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_723542760 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,351 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18526 with signal TERM. Exit code 0
2013-10-31 18:30:13,367 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-2648717928242097379_1047
2013-10-31 18:30:13,416 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,416 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,416 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:13,417 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-378893990 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:13,529 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,530 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,530 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:13,530 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-908586741 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:13,544 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0006_m_000005_0' to tip task_20131031182606197_0006_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:13,547 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,549 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,549 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:13,550 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_723542760 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:13,551 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:30:13,551 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000005_0 which needs 1 slots
2013-10-31 18:30:13,551 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000005_0 which needs 1 slots
2013-10-31 18:30:13,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken	dst=null	perm=null
2013-10-31 18:30:13,557 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46831, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1426554221262928588_1056, duration: 179561
2013-10-31 18:30:13,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=null
2013-10-31 18:30:13,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46550, bytes: 28542, op: HDFS_READ, cliID: DFSClient_1909659099, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 435826
2013-10-31 18:30:13,586 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:13,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=null
2013-10-31 18:30:13,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46551, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1909659099, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3900087759881409316_1050, duration: 1362767
2013-10-31 18:30:13,717 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_-740270901
2013-10-31 18:30:13,718 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_-740270901 spawned.
2013-10-31 18:30:13,720 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000005_0/taskjvm.sh
2013-10-31 18:30:13,745 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-739234499 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,755 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18411 with signal TERM. Exit code 0
2013-10-31 18:30:13,817 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_r_259930158 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,827 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18599 with signal TERM. Exit code 0
2013-10-31 18:30:14,000 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:14,000 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:14,000 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:14,000 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_r_259930158 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:14,001 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:14,001 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:14,002 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:14,002 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-739234499 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:15,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2648717928242097379_1047 file build/test/data/dfs/data/data1/current/blk_-2648717928242097379 for deletion
2013-10-31 18:30:15,110 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2648717928242097379_1047 at file build/test/data/dfs/data/data1/current/blk_-2648717928242097379
2013-10-31 18:30:18,064 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_-740270901 given task: attempt_20131031182606197_0006_m_000005_0
2013-10-31 18:30:18,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:21,707 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000005_0 0.0% setup
2013-10-31 18:30:21,710 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000005_0 is done.
2013-10-31 18:30:21,711 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000005_0  was -1
2013-10-31 18:30:21,711 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:22,562 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000005_0' has completed task_20131031182606197_0006_m_000005 successfully.
2013-10-31 18:30:22,566 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000000_0' to tip task_20131031182606197_0006_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:22,567 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000000
2013-10-31 18:30:22,569 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:30:22,569 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000000_0 which needs 1 slots
2013-10-31 18:30:22,569 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000000_0 which needs 1 slots
2013-10-31 18:30:22,591 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000001_0' to tip task_20131031182606197_0006_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:30:22,593 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000001
2013-10-31 18:30:22,595 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:30:22,595 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000001_0 which needs 1 slots
2013-10-31 18:30:22,595 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000002_0' to tip task_20131031182606197_0006_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:30:22,595 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000001_0 which needs 1 slots
2013-10-31 18:30:22,596 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000002
2013-10-31 18:30:22,597 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:30:22,597 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000002_0 which needs 1 slots
2013-10-31 18:30:22,597 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000002_0 which needs 1 slots
2013-10-31 18:30:22,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken	dst=null	perm=null
2013-10-31 18:30:22,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken	dst=null	perm=null
2013-10-31 18:30:22,603 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_95840884
2013-10-31 18:30:22,604 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_95840884 spawned.
2013-10-31 18:30:22,606 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42663, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1426554221262928588_1056, duration: 148999
2013-10-31 18:30:22,606 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000000_0/taskjvm.sh
2013-10-31 18:30:22,607 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49467, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1426554221262928588_1056, duration: 114387
2013-10-31 18:30:22,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=null
2013-10-31 18:30:22,619 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46557, bytes: 28542, op: HDFS_READ, cliID: DFSClient_-1113497225, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 298525
2013-10-31 18:30:22,647 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:22,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=null
2013-10-31 18:30:22,683 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46841, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1113497225, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3900087759881409316_1050, duration: 1684079
2013-10-31 18:30:22,783 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_941089074
2013-10-31 18:30:22,784 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_941089074 spawned.
2013-10-31 18:30:22,785 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000001_0/taskjvm.sh
2013-10-31 18:30:22,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=null
2013-10-31 18:30:23,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42669, bytes: 28542, op: HDFS_READ, cliID: DFSClient_1180319444, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2472956342887107208_1053, duration: 440384
2013-10-31 18:30:23,286 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:23,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=null
2013-10-31 18:30:23,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49473, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1180319444, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3900087759881409316_1050, duration: 1526216
2013-10-31 18:30:23,384 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_-888949500
2013-10-31 18:30:23,384 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_-888949500 spawned.
2013-10-31 18:30:23,385 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000002_0/taskjvm.sh
2013-10-31 18:30:24,303 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_95840884 given task: attempt_20131031182606197_0006_m_000000_0
2013-10-31 18:30:24,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=null
2013-10-31 18:30:24,796 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49476, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2287880348402893959_1051, duration: 386736
2013-10-31 18:30:24,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:30:24,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46848, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 263217
2013-10-31 18:30:25,565 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000003_0' to tip task_20131031182606197_0006_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:30:25,566 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000003
2013-10-31 18:30:25,568 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:30:25,569 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000003_0 which needs 1 slots
2013-10-31 18:30:25,569 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000003_0 which needs 1 slots
2013-10-31 18:30:25,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken	dst=null	perm=null
2013-10-31 18:30:25,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42675, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1426554221262928588_1056, duration: 322760
2013-10-31 18:30:25,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml	dst=null	perm=null
2013-10-31 18:30:25,591 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46568, bytes: 28542, op: HDFS_READ, cliID: DFSClient_889025810, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 476710
2013-10-31 18:30:25,624 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:25,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar	dst=null	perm=null
2013-10-31 18:30:25,653 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46569, bytes: 239915, op: HDFS_READ, cliID: DFSClient_889025810, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3900087759881409316_1050, duration: 1597480
2013-10-31 18:30:27,569 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0006_m_000005_0
2013-10-31 18:30:27,570 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0006_m_000005_0
2013-10-31 18:30:27,570 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0006_m_000005_0 not found in cache
2013-10-31 18:30:27,725 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:30:27,729 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000000_0 is done.
2013-10-31 18:30:27,729 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000000_0  was 54
2013-10-31 18:30:27,729 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:27,860 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_1952810705
2013-10-31 18:30:27,861 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_1952810705 spawned.
2013-10-31 18:30:27,862 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000003_0/taskjvm.sh
2013-10-31 18:30:28,573 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000000_0' has completed task_20131031182606197_0006_m_000000 successfully.
2013-10-31 18:30:28,630 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_941089074 given task: attempt_20131031182606197_0006_m_000001_0
2013-10-31 18:30:28,640 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_-888949500 given task: attempt_20131031182606197_0006_m_000002_0
2013-10-31 18:30:28,827 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0006_r_000000_0' to tip task_20131031182606197_0006_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:28,829 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:30:28,829 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_r_000000_0 which needs 1 slots
2013-10-31 18:30:28,829 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_r_000000_0 which needs 1 slots
2013-10-31 18:30:28,862 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_r_-1824933735
2013-10-31 18:30:28,863 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_r_-1824933735 spawned.
2013-10-31 18:30:28,864 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_r_000000_0/taskjvm.sh
2013-10-31 18:30:29,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=null
2013-10-31 18:30:29,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=null
2013-10-31 18:30:29,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42683, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2287880348402893959_1051, duration: 176492
2013-10-31 18:30:29,157 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46575, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2287880348402893959_1051, duration: 147269
2013-10-31 18:30:29,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:30:29,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:30:29,201 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46576, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 176343
2013-10-31 18:30:29,442 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49490, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 195913
2013-10-31 18:30:29,633 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_1952810705 given task: attempt_20131031182606197_0006_m_000003_0
2013-10-31 18:30:29,750 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_r_-1824933735 given task: attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:30,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split	dst=null	perm=null
2013-10-31 18:30:30,138 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46865, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2287880348402893959_1051, duration: 133965
2013-10-31 18:30:30,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:30:30,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49495, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 157402
2013-10-31 18:30:32,084 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:30:32,087 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:30:32,089 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000001_0 is done.
2013-10-31 18:30:32,090 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000001_0  was 74
2013-10-31 18:30:32,090 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:32,090 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000002_0 is done.
2013-10-31 18:30:32,091 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000002_0  was 73
2013-10-31 18:30:32,091 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:33,068 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:30:33,071 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000003_0 is done.
2013-10-31 18:30:33,072 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000003_0  was 53
2013-10-31 18:30:33,072 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:34,575 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000003_0' has completed task_20131031182606197_0006_m_000003 successfully.
2013-10-31 18:30:34,837 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000002_0' has completed task_20131031182606197_0006_m_000002 successfully.
2013-10-31 18:30:34,840 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000001_0' has completed task_20131031182606197_0006_m_000001 successfully.
2013-10-31 18:30:35,431 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48536, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000000_0, duration: 9819604
2013-10-31 18:30:36,249 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:30:36,963 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-4839348806796864519_1019
2013-10-31 18:30:37,838 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:30:39,298 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:30:40,467 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43579, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000003_0, duration: 14509805
2013-10-31 18:30:40,485 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40904, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000002_0, duration: 12866345
2013-10-31 18:30:40,502 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38884, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000001_0, duration: 12524880
2013-10-31 18:30:41,303 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:30:41,356 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:30:41,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:41,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:41,568 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000. blk_-5512389547783664916_1057
2013-10-31 18:30:41,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5512389547783664916_1057 src: /127.0.0.1:46594 dest: /127.0.0.1:37740
2013-10-31 18:30:41,594 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5512389547783664916_1057 src: /127.0.0.1:46878 dest: /127.0.0.1:54365
2013-10-31 18:30:41,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5512389547783664916_1057 src: /127.0.0.1:42705 dest: /127.0.0.1:59471
2013-10-31 18:30:41,598 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42705, dest: /127.0.0.1:59471, bytes: 1376, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0006_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5512389547783664916_1057, duration: 2334425
2013-10-31 18:30:41,600 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5512389547783664916_1057 terminating
2013-10-31 18:30:41,604 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5512389547783664916_1057 size 1376
2013-10-31 18:30:41,605 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46878, dest: /127.0.0.1:54365, bytes: 1376, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0006_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5512389547783664916_1057, duration: 9004054
2013-10-31 18:30:41,606 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5512389547783664916_1057 terminating
2013-10-31 18:30:41,607 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46594, dest: /127.0.0.1:37740, bytes: 1376, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0006_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5512389547783664916_1057, duration: 10523556
2013-10-31 18:30:41,607 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5512389547783664916_1057 terminating
2013-10-31 18:30:41,608 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5512389547783664916_1057 size 1376
2013-10-31 18:30:41,611 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:41,611 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:41,611 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5512389547783664916_1057 size 1376
2013-10-31 18:30:41,657 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0006_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:30:41,658 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:30:43,846 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   3 OK for attempt_20131031182606197_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:30:43,847 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:44,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0	dst=null	perm=null
2013-10-31 18:30:44,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:44,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:45,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0	dst=null	perm=null
2013-10-31 18:30:45,352 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 18:30:45,354 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 18:30:45,356 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_r_000000_0 is done.
2013-10-31 18:30:45,356 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_r_000000_0  was -1
2013-10-31 18:30:45,356 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:46,851 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_r_000000_0' has completed task_20131031182606197_0006_r_000000 successfully.
2013-10-31 18:30:46,856 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0006_m_000004_0' to tip task_20131031182606197_0006_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:46,859 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:30:46,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000004_0 which needs 1 slots
2013-10-31 18:30:46,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000004_0 which needs 1 slots
2013-10-31 18:30:46,900 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0006/attempt_20131031182606197_0006_m_000004_0. Attempting to reuse: jvm_20131031182606197_0006_m_-740270901
2013-10-31 18:30:47,796 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_-740270901 given task: attempt_20131031182606197_0006_m_000004_0
2013-10-31 18:30:47,900 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000004_0 0.0% 
2013-10-31 18:30:47,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary	dst=null	perm=null
2013-10-31 18:30:47,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:47,921 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_SUCCESS from client DFSClient_attempt_20131031182606197_0006_m_000004_0
2013-10-31 18:30:47,921 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0006_m_000004_0
2013-10-31 18:30:47,926 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:47,926 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,926 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,927 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:47,927 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,927 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:47,927 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:47,928 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,928 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1936656076941190583 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:47,928 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1936656076941190583 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,928 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1936656076941190583 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2472956342887107208 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2472956342887107208 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:47,929 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2472956342887107208 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006	dst=null	perm=null
2013-10-31 18:30:49,373 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-2472956342887107208_1053 blk_-1936656076941190583_1052
2013-10-31 18:30:49,373 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-1936656076941190583_1052
2013-10-31 18:30:49,996 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1936656076941190583_1052 file build/test/data/dfs/data/data4/current/blk_-1936656076941190583 for deletion
2013-10-31 18:30:49,996 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data3/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:49,996 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1936656076941190583_1052 at file build/test/data/dfs/data/data4/current/blk_-1936656076941190583
2013-10-31 18:30:49,997 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data4/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:49,997 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data3/current/blk_2287880348402893959
2013-10-31 18:30:49,997 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data4/current/blk_3900087759881409316
2013-10-31 18:30:50,871 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000004_0 0.0% cleanup
2013-10-31 18:30:50,874 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000004_0 is done.
2013-10-31 18:30:50,874 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000004_0  was -1
2013-10-31 18:30:50,874 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:51,122 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2472956342887107208_1053 file build/test/data/dfs/data/data2/current/blk_-2472956342887107208 for deletion
2013-10-31 18:30:51,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1936656076941190583_1052 file build/test/data/dfs/data/data1/current/blk_-1936656076941190583 for deletion
2013-10-31 18:30:51,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2472956342887107208_1053 at file build/test/data/dfs/data/data2/current/blk_-2472956342887107208
2013-10-31 18:30:51,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data2/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:51,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data2/current/blk_2287880348402893959
2013-10-31 18:30:51,123 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1936656076941190583_1052 at file build/test/data/dfs/data/data1/current/blk_-1936656076941190583
2013-10-31 18:30:51,124 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data1/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:51,127 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data1/current/blk_3900087759881409316
2013-10-31 18:30:51,859 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:51,860 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:52,374 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-2472956342887107208_1053 blk_-1936656076941190583_1052
2013-10-31 18:30:52,374 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-2472956342887107208_1053
2013-10-31 18:30:52,867 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000004_0' has completed task_20131031182606197_0006_m_000004 successfully.
2013-10-31 18:30:53,709 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2472956342887107208_1053 file build/test/data/dfs/data/data6/current/blk_-2472956342887107208 for deletion
2013-10-31 18:30:53,709 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data5/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:53,710 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data6/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:54,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2472956342887107208_1053 file build/test/data/dfs/data/data7/current/blk_-2472956342887107208 for deletion
2013-10-31 18:30:54,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1936656076941190583_1052 file build/test/data/dfs/data/data8/current/blk_-1936656076941190583 for deletion
2013-10-31 18:30:54,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data7/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:54,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data8/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:55,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1936656076941190583_1052 at file build/test/data/dfs/data/data8/current/blk_-1936656076941190583
2013-10-31 18:30:55,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2472956342887107208_1053 at file build/test/data/dfs/data/data6/current/blk_-2472956342887107208
2013-10-31 18:30:55,740 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data8/current/blk_3900087759881409316
2013-10-31 18:30:55,741 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data6/current/blk_3900087759881409316
2013-10-31 18:30:55,746 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0006 has completed successfully.
2013-10-31 18:30:55,747 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0006,submitTime=1383244210700,launchTime=1383244210830,firstMapTaskLaunchTime=1383244222566,firstReduceTaskLaunchTime=1383244228827,firstJobSetupTaskLaunchTime=1383244213544,firstJobCleanupTaskLaunchTime=1383244246856,finishTime=1383244255746,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[451BE7ACA61247E4A72FF8F7D978C016/ED9389E3934B4561A8B31ED9C6E7A142] test/(1/1) ...tform/generatoraggregator
2013-10-31 18:30:55,760 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561. blk_-8363873052003505238_1058
2013-10-31 18:30:55,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8363873052003505238_1058 src: /127.0.0.1:49513 dest: /127.0.0.1:34578
2013-10-31 18:30:55,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8363873052003505238_1058 src: /127.0.0.1:42711 dest: /127.0.0.1:59471
2013-10-31 18:30:55,766 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8363873052003505238_1058 src: /127.0.0.1:46603 dest: /127.0.0.1:37740
2013-10-31 18:30:55,776 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46603, dest: /127.0.0.1:37740, bytes: 28323, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8363873052003505238_1058, duration: 6457087
2013-10-31 18:30:55,777 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8363873052003505238_1058 terminating
2013-10-31 18:30:55,778 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42711, dest: /127.0.0.1:59471, bytes: 28323, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8363873052003505238_1058, duration: 5284250
2013-10-31 18:30:55,778 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8363873052003505238_1058 terminating
2013-10-31 18:30:55,779 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49513, dest: /127.0.0.1:34578, bytes: 28323, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8363873052003505238_1058, duration: 9614698
2013-10-31 18:30:55,780 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8363873052003505238_1058 size 28323
2013-10-31 18:30:55,780 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8363873052003505238_1058 terminating
2013-10-31 18:30:55,784 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8363873052003505238_1058 size 28323
2013-10-31 18:30:55,784 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8363873052003505238_1058 size 28323
2013-10-31 18:30:55,785 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 from client DFSClient_592994435
2013-10-31 18:30:55,785 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 is closed by DFSClient_592994435
2013-10-31 18:30:55,790 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data5/current/blk_2287880348402893959
2013-10-31 18:30:55,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2472956342887107208_1053 at file build/test/data/dfs/data/data7/current/blk_-2472956342887107208
2013-10-31 18:30:55,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data7/current/blk_2287880348402893959
2013-10-31 18:30:55,801 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:55,802 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000000_0'
2013-10-31 18:30:55,802 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000004_0'
2013-10-31 18:30:55,803 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000005_0'
2013-10-31 18:30:55,804 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_r_000000_0'
2013-10-31 18:30:55,804 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1426554221262928588 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:55,804 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1426554221262928588 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:55,804 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000001_0'
2013-10-31 18:30:55,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1426554221262928588 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:55,808 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0006_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:55,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006	dst=null	perm=null
2013-10-31 18:30:55,813 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary
2013-10-31 18:30:55,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator	dst=null	perm=null
2013-10-31 18:30:55,835 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:55,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000	dst=null	perm=null
2013-10-31 18:30:55,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000	dst=null	perm=null
2013-10-31 18:30:55,839 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46605, bytes: 1388, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5512389547783664916_1057, duration: 503896
2013-10-31 18:30:55,840 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/generatoraggregator
2013-10-31 18:30:55,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator	dst=null	perm=null
2013-10-31 18:30:55,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000	dst=null	perm=null
2013-10-31 18:30:55,847 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46606, bytes: 1388, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5512389547783664916_1057, duration: 542499
2013-10-31 18:30:55,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:55,855 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000003_0'
2013-10-31 18:30:55,856 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt. blk_-249196459070022847_1059
2013-10-31 18:30:55,857 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249196459070022847_1059 src: /127.0.0.1:46607 dest: /127.0.0.1:37740
2013-10-31 18:30:55,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249196459070022847_1059 src: /127.0.0.1:42717 dest: /127.0.0.1:59471
2013-10-31 18:30:55,860 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249196459070022847_1059 src: /127.0.0.1:46892 dest: /127.0.0.1:54365
2013-10-31 18:30:55,861 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46892, dest: /127.0.0.1:54365, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-249196459070022847_1059, duration: 1160196
2013-10-31 18:30:55,862 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-249196459070022847_1059 terminating
2013-10-31 18:30:55,862 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42717, dest: /127.0.0.1:59471, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-249196459070022847_1059, duration: 1669468
2013-10-31 18:30:55,862 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-249196459070022847_1059 size 15
2013-10-31 18:30:55,862 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-249196459070022847_1059 terminating
2013-10-31 18:30:55,863 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46607, dest: /127.0.0.1:37740, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-249196459070022847_1059, duration: 2138552
2013-10-31 18:30:55,864 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-249196459070022847_1059 size 15
2013-10-31 18:30:55,864 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-249196459070022847_1059 terminating
2013-10-31 18:30:55,866 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt from client DFSClient_-1596270109
2013-10-31 18:30:55,867 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt is closed by DFSClient_-1596270109
2013-10-31 18:30:55,867 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-249196459070022847_1059 size 15
2013-10-31 18:30:55,867 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000002_0'
2013-10-31 18:30:55,888 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:30:55,889 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:30:55,921 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] starting
2013-10-31 18:30:55,921 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 18:30:55,922 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:30:55,922 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt"]
2013-10-31 18:30:55,922 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree"]
2013-10-31 18:30:55,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  parallel execution is enabled: true
2013-10-31 18:30:55,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  starting jobs: 1
2013-10-31 18:30:55,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merge]  allocating threads: 1
2013-10-31 18:30:55,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] starting step: (1/1) ...platform/simplemergethree
2013-10-31 18:30:55,928 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:30:55,928 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:30:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:30:56,018 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,046 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 36 records
2013-10-31 18:30:56,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:56,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:30:56,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,174 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar. blk_7334543370624894983_1060
2013-10-31 18:30:56,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:46610 dest: /127.0.0.1:37740
2013-10-31 18:30:56,177 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:42720 dest: /127.0.0.1:59471
2013-10-31 18:30:56,181 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:46895 dest: /127.0.0.1:54365
2013-10-31 18:30:56,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46895, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7334543370624894983_1060, duration: 4722778
2013-10-31 18:30:56,190 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7334543370624894983_1060 terminating
2013-10-31 18:30:56,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42720, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7334543370624894983_1060, duration: 6234896
2013-10-31 18:30:56,192 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7334543370624894983_1060 terminating
2013-10-31 18:30:56,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46610, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7334543370624894983_1060, duration: 8039710
2013-10-31 18:30:56,193 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:30:56,194 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7334543370624894983_1060 terminating
2013-10-31 18:30:56,195 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar from client DFSClient_-1596270109
2013-10-31 18:30:56,196 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:30:56,196 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:30:56,198 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:30:56,201 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar. New replication is 10
2013-10-31 18:30:56,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=null
2013-10-31 18:30:56,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,211 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:30:56,218 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:30:56,222 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 18:30:56,225 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:30:56,229 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:30:56,232 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 18:30:56,235 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:30:56,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,249 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split. New replication is 10
2013-10-31 18:30:56,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:30:56,256 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split. blk_2855333912159915853_1061
2013-10-31 18:30:56,258 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:46896 dest: /127.0.0.1:54365
2013-10-31 18:30:56,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:42723 dest: /127.0.0.1:59471
2013-10-31 18:30:56,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:49527 dest: /127.0.0.1:34578
2013-10-31 18:30:56,263 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:46616 dest: /127.0.0.1:37740
2013-10-31 18:30:56,269 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46616, dest: /127.0.0.1:37740, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2855333912159915853_1061, duration: 1254357
2013-10-31 18:30:56,270 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,271 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49527, dest: /127.0.0.1:34578, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 2559922
2013-10-31 18:30:56,271 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,272 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,273 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42723, dest: /127.0.0.1:59471, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2855333912159915853_1061, duration: 4486291
2013-10-31 18:30:56,273 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,274 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46896, dest: /127.0.0.1:54365, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 5933692
2013-10-31 18:30:56,275 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,275 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,277 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,278 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split from client DFSClient_-1596270109
2013-10-31 18:30:56,278 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split is closed by DFSClient_-1596270109
2013-10-31 18:30:56,279 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,298 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo. blk_-1355772319426900150_1062
2013-10-31 18:30:56,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1355772319426900150_1062 src: /127.0.0.1:46900 dest: /127.0.0.1:54365
2013-10-31 18:30:56,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1355772319426900150_1062 src: /127.0.0.1:42727 dest: /127.0.0.1:59471
2013-10-31 18:30:56,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1355772319426900150_1062 src: /127.0.0.1:46619 dest: /127.0.0.1:37740
2013-10-31 18:30:56,307 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46619, dest: /127.0.0.1:37740, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1355772319426900150_1062, duration: 945870
2013-10-31 18:30:56,307 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1355772319426900150_1062 terminating
2013-10-31 18:30:56,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42727, dest: /127.0.0.1:59471, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1355772319426900150_1062, duration: 2495784
2013-10-31 18:30:56,309 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1355772319426900150_1062 terminating
2013-10-31 18:30:56,310 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46900, dest: /127.0.0.1:54365, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1355772319426900150_1062, duration: 4254730
2013-10-31 18:30:56,311 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1355772319426900150_1062 terminating
2013-10-31 18:30:56,313 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1355772319426900150_1062 size 323
2013-10-31 18:30:56,313 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:30:56,314 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:30:56,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1355772319426900150_1062 size 323
2013-10-31 18:30:56,315 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1355772319426900150_1062 size 323
2013-10-31 18:30:56,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,522 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml. blk_6179045511188231419_1063
2013-10-31 18:30:56,524 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6179045511188231419_1063 src: /127.0.0.1:49532 dest: /127.0.0.1:34578
2013-10-31 18:30:56,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6179045511188231419_1063 src: /127.0.0.1:42730 dest: /127.0.0.1:59471
2013-10-31 18:30:56,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6179045511188231419_1063 src: /127.0.0.1:46905 dest: /127.0.0.1:54365
2013-10-31 18:30:56,532 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46905, dest: /127.0.0.1:54365, bytes: 29347, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6179045511188231419_1063, duration: 2138085
2013-10-31 18:30:56,532 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6179045511188231419_1063 terminating
2013-10-31 18:30:56,533 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42730, dest: /127.0.0.1:59471, bytes: 29347, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6179045511188231419_1063, duration: 2935964
2013-10-31 18:30:56,533 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6179045511188231419_1063 terminating
2013-10-31 18:30:56,533 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49532, dest: /127.0.0.1:34578, bytes: 29347, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 3755176
2013-10-31 18:30:56,533 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6179045511188231419_1063 size 29347
2013-10-31 18:30:56,534 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6179045511188231419_1063 terminating
2013-10-31 18:30:56,537 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml from client DFSClient_-1596270109
2013-10-31 18:30:56,537 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:30:56,537 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6179045511188231419_1063 size 29347
2013-10-31 18:30:56,538 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6179045511188231419_1063 size 29347
2013-10-31 18:30:56,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=null
2013-10-31 18:30:56,552 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46907, bytes: 29579, op: HDFS_READ, cliID: DFSClient_314529799, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6179045511188231419_1063, duration: 410330
2013-10-31 18:30:56,571 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0007: nMaps=9 nReduces=1 max=-1
2013-10-31 18:30:56,571 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0007 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:30:56,571 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0007
2013-10-31 18:30:56,572 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0007	RESULT=SUCCESS
2013-10-31 18:30:56,572 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0007
2013-10-31 18:30:56,574 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] submitted hadoop job: job_20131031182606197_0007
2013-10-31 18:30:56,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,610 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml. blk_-3790333918479950543_1065
2013-10-31 18:30:56,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3790333918479950543_1065 src: /127.0.0.1:46625 dest: /127.0.0.1:37740
2013-10-31 18:30:56,614 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3790333918479950543_1065 src: /127.0.0.1:46909 dest: /127.0.0.1:54365
2013-10-31 18:30:56,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3790333918479950543_1065 src: /127.0.0.1:42736 dest: /127.0.0.1:59471
2013-10-31 18:30:56,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42736, dest: /127.0.0.1:59471, bytes: 29412, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3790333918479950543_1065, duration: 2137349
2013-10-31 18:30:56,622 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3790333918479950543_1065 terminating
2013-10-31 18:30:56,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46909, dest: /127.0.0.1:54365, bytes: 29412, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3790333918479950543_1065, duration: 3834333
2013-10-31 18:30:56,624 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3790333918479950543_1065 terminating
2013-10-31 18:30:56,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46625, dest: /127.0.0.1:37740, bytes: 29412, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3790333918479950543_1065, duration: 5287648
2013-10-31 18:30:56,625 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3790333918479950543_1065 terminating
2013-10-31 18:30:56,628 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3790333918479950543_1065 size 29412
2013-10-31 18:30:56,629 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml from client DFSClient_314529799
2013-10-31 18:30:56,629 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml is closed by DFSClient_314529799
2013-10-31 18:30:56,629 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3790333918479950543_1065 size 29412
2013-10-31 18:30:56,630 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3790333918479950543_1065 size 29412
2013-10-31 18:30:56,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,642 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken. blk_-8063380550776907754_1066
2013-10-31 18:30:56,643 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8063380550776907754_1066 src: /127.0.0.1:42737 dest: /127.0.0.1:59471
2013-10-31 18:30:56,645 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8063380550776907754_1066 src: /127.0.0.1:46629 dest: /127.0.0.1:37740
2013-10-31 18:30:56,646 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8063380550776907754_1066 src: /127.0.0.1:49542 dest: /127.0.0.1:34578
2013-10-31 18:30:56,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49542, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8063380550776907754_1066, duration: 952959
2013-10-31 18:30:56,651 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8063380550776907754_1066 terminating
2013-10-31 18:30:56,652 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46629, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8063380550776907754_1066, duration: 2725429
2013-10-31 18:30:56,652 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8063380550776907754_1066 terminating
2013-10-31 18:30:56,654 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42737, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8063380550776907754_1066, duration: 4477718
2013-10-31 18:30:56,654 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8063380550776907754_1066 size 116
2013-10-31 18:30:56,655 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8063380550776907754_1066 terminating
2013-10-31 18:30:56,655 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8063380550776907754_1066 size 116
2013-10-31 18:30:56,657 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8063380550776907754_1066 size 116
2013-10-31 18:30:56,658 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken from client DFSClient_-1596270109
2013-10-31 18:30:56,658 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:30:56,663 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken
2013-10-31 18:30:56,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:30:56,667 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42740, bytes: 327, op: HDFS_READ, cliID: DFSClient_314529799, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1355772319426900150_1062, duration: 345816
2013-10-31 18:30:56,669 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0007 = 53. Number of splits = 9
2013-10-31 18:30:56,669 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,674 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000006 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,674 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000006 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,674 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000006 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000007 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000007 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000007 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000008 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000008 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000008 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,676 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0007 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:30:56,677 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0007 initialized successfully with 9 map tasks and 1 reduce tasks.
2013-10-31 18:30:58,375 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_7334543370624894983_1060 to datanode(s) 127.0.0.1:34578
2013-10-31 18:30:58,376 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_1426554221262928588_1056
2013-10-31 18:30:58,376 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_1426554221262928588_1056
2013-10-31 18:30:58,809 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0007_m_000010_0' to tip task_20131031182606197_0007_m_000010, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:58,815 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000010_0 task's state:UNASSIGNED
2013-10-31 18:30:58,815 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000010_0 which needs 1 slots
2013-10-31 18:30:58,815 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000010_0 which needs 1 slots
2013-10-31 18:30:58,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken	dst=null	perm=null
2013-10-31 18:30:58,824 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49544, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8063380550776907754_1066, duration: 318453
2013-10-31 18:30:58,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=null
2013-10-31 18:30:58,835 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46917, bytes: 29579, op: HDFS_READ, cliID: DFSClient_1394048599, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6179045511188231419_1063, duration: 388648
2013-10-31 18:30:58,862 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:58,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=null
2013-10-31 18:30:58,881 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46635, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1394048599, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7334543370624894983_1060, duration: 1385173
2013-10-31 18:30:58,979 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0006_m_95840884
2013-10-31 18:30:58,986 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19730 with signal TERM. Exit code 0
2013-10-31 18:30:58,986 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:30:58,986 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1975138276 spawned.
2013-10-31 18:30:58,987 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000010_0/taskjvm.sh
2013-10-31 18:30:58,998 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1426554221262928588_1056 file build/test/data/dfs/data/data4/current/blk_1426554221262928588 for deletion
2013-10-31 18:30:58,999 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1426554221262928588_1056 at file build/test/data/dfs/data/data4/current/blk_1426554221262928588
2013-10-31 18:30:59,076 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:59,076 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:59,076 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:30:59,076 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_95840884 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:59,710 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1426554221262928588_1056 file build/test/data/dfs/data/data5/current/blk_1426554221262928588 for deletion
2013-10-31 18:30:59,710 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1426554221262928588_1056 at file build/test/data/dfs/data/data5/current/blk_1426554221262928588
2013-10-31 18:31:00,197 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_7334543370624894983_1060 to 127.0.0.1:34578 
2013-10-31 18:31:00,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:49549 dest: /127.0.0.1:34578
2013-10-31 18:31:00,198 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_7334543370624894983_1060 to /127.0.0.1:34578
2013-10-31 18:31:00,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7334543370624894983_1060 src: /127.0.0.1:49549 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:31:00,203 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:31:00,227 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000010_0
2013-10-31 18:31:00,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:00,805 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,806 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0006_m_000004_0 not found in cache
2013-10-31 18:31:00,807 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660807
2013-10-31 18:31:00,843 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,844 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660844
2013-10-31 18:31:00,855 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,856 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660856
2013-10-31 18:31:00,868 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,869 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660869
2013-10-31 18:31:00,898 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_r_-1824933735 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:00,908 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19928 with signal TERM. Exit code 0
2013-10-31 18:31:01,076 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:01,076 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:01,076 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:01,077 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_r_-1824933735 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:01,173 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_941089074 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:01,173 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_-888949500 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:01,184 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19805 with signal TERM. Exit code 0
2013-10-31 18:31:01,185 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19806 with signal TERM. Exit code 0
2013-10-31 18:31:01,377 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1426554221262928588_1056
2013-10-31 18:31:01,380 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:01,380 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:01,380 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:01,380 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_941089074 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:01,389 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:01,389 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:01,390 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:01,390 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_-888949500 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:01,915 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_-740270901 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:01,928 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19617 with signal TERM. Exit code 0
2013-10-31 18:31:02,111 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:02,112 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:02,112 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:02,112 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_-740270901 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:31:02,164 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_1952810705 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:02,174 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19893 with signal TERM. Exit code 0
2013-10-31 18:31:02,392 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:02,392 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:02,392 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:02,392 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_1952810705 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:03,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1426554221262928588_1056 file build/test/data/dfs/data/data2/current/blk_1426554221262928588 for deletion
2013-10-31 18:31:03,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1426554221262928588_1056 at file build/test/data/dfs/data/data2/current/blk_1426554221262928588
2013-10-31 18:31:03,644 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000010_0 0.0% setup
2013-10-31 18:31:03,647 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000010_0 is done.
2013-10-31 18:31:03,648 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000010_0  was -1
2013-10-31 18:31:03,648 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:04,819 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000010_0' has completed task_20131031182606197_0007_m_000010 successfully.
2013-10-31 18:31:04,823 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000000_0' to tip task_20131031182606197_0007_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:04,824 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000000
2013-10-31 18:31:04,824 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000001_0' to tip task_20131031182606197_0007_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:04,825 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000001
2013-10-31 18:31:04,827 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:31:04,828 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:31:04,828 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000000_0 which needs 1 slots
2013-10-31 18:31:04,828 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000000_0 which needs 1 slots
2013-10-31 18:31:04,829 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000001_0 which needs 1 slots
2013-10-31 18:31:04,829 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000001_0 which needs 1 slots
2013-10-31 18:31:04,854 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000002_0' to tip task_20131031182606197_0007_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:31:04,855 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000002
2013-10-31 18:31:04,856 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000003_0' to tip task_20131031182606197_0007_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:31:04,856 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000003
2013-10-31 18:31:04,857 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:31:04,857 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:31:04,858 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000002_0 which needs 1 slots
2013-10-31 18:31:04,858 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000002_0 which needs 1 slots
2013-10-31 18:31:04,858 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000003_0 which needs 1 slots
2013-10-31 18:31:04,858 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000003_0 which needs 1 slots
2013-10-31 18:31:04,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken	dst=null	perm=null
2013-10-31 18:31:04,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46639, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8063380550776907754_1066, duration: 147115
2013-10-31 18:31:04,863 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000004_0' to tip task_20131031182606197_0007_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:31:04,863 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000004
2013-10-31 18:31:04,863 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000005_0' to tip task_20131031182606197_0007_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:31:04,863 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000005
2013-10-31 18:31:04,866 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:31:04,866 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:31:04,866 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000004_0 which needs 1 slots
2013-10-31 18:31:04,866 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000004_0 which needs 1 slots
2013-10-31 18:31:04,866 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000005_0 which needs 1 slots
2013-10-31 18:31:04,866 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000005_0 which needs 1 slots
2013-10-31 18:31:04,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=null
2013-10-31 18:31:04,867 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-1626281300
2013-10-31 18:31:04,868 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-1626281300 spawned.
2013-10-31 18:31:04,868 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0007/attempt_20131031182606197_0007_m_000001_0. Attempting to reuse: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:31:04,869 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000000_0/taskjvm.sh
2013-10-31 18:31:04,870 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49553, bytes: 29579, op: HDFS_READ, cliID: DFSClient_1615040230, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 187361
2013-10-31 18:31:04,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken	dst=null	perm=null
2013-10-31 18:31:04,871 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49554, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8063380550776907754_1066, duration: 160675
2013-10-31 18:31:04,874 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000006_0' to tip task_20131031182606197_0007_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:31:04,874 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000006
2013-10-31 18:31:04,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=null
2013-10-31 18:31:04,875 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000007_0' to tip task_20131031182606197_0007_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:31:04,875 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000007
2013-10-31 18:31:04,876 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:31:04,876 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:31:04,876 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000006_0 which needs 1 slots
2013-10-31 18:31:04,876 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000006_0 which needs 1 slots
2013-10-31 18:31:04,876 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000007_0 which needs 1 slots
2013-10-31 18:31:04,877 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000007_0 which needs 1 slots
2013-10-31 18:31:04,877 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49556, bytes: 29579, op: HDFS_READ, cliID: DFSClient_922432685, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 209484
2013-10-31 18:31:04,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken	dst=null	perm=null
2013-10-31 18:31:04,880 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46645, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8063380550776907754_1066, duration: 113887
2013-10-31 18:31:04,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml	dst=null	perm=null
2013-10-31 18:31:04,884 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:04,885 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49559, bytes: 29579, op: HDFS_READ, cliID: DFSClient_-829471730, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 164898
2013-10-31 18:31:04,890 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:04,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=null
2013-10-31 18:31:04,898 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:04,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46648, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1615040230, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7334543370624894983_1060, duration: 630186
2013-10-31 18:31:04,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=null
2013-10-31 18:31:04,905 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42758, bytes: 239915, op: HDFS_READ, cliID: DFSClient_922432685, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7334543370624894983_1060, duration: 669502
2013-10-31 18:31:04,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar	dst=null	perm=null
2013-10-31 18:31:04,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49562, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-829471730, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7334543370624894983_1060, duration: 671272
2013-10-31 18:31:04,967 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-1489999599
2013-10-31 18:31:04,968 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-1489999599 spawned.
2013-10-31 18:31:04,968 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-977462392
2013-10-31 18:31:04,969 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-977462392 spawned.
2013-10-31 18:31:04,970 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000003_0/taskjvm.sh
2013-10-31 18:31:04,971 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000002_0/taskjvm.sh
2013-10-31 18:31:05,050 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1239478468
2013-10-31 18:31:05,052 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1239478468 spawned.
2013-10-31 18:31:05,053 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-1003825976
2013-10-31 18:31:05,053 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1064165913
2013-10-31 18:31:05,054 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-1003825976 spawned.
2013-10-31 18:31:05,057 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1064165913 spawned.
2013-10-31 18:31:05,059 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1599992582
2013-10-31 18:31:05,060 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1599992582 spawned.
2013-10-31 18:31:05,060 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000005_0/taskjvm.sh
2013-10-31 18:31:05,064 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000007_0/taskjvm.sh
2013-10-31 18:31:05,064 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000004_0/taskjvm.sh
2013-10-31 18:31:05,065 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000006_0/taskjvm.sh
2013-10-31 18:31:05,210 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000001_0
2013-10-31 18:31:05,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:05,329 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49564, bytes: 3161, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 178094
2013-10-31 18:31:05,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:31:05,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49565, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 110737
2013-10-31 18:31:07,247 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-1489999599 given task: attempt_20131031182606197_0007_m_000003_0
2013-10-31 18:31:07,249 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1064165913 given task: attempt_20131031182606197_0007_m_000004_0
2013-10-31 18:31:07,251 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1599992582 given task: attempt_20131031182606197_0007_m_000006_0
2013-10-31 18:31:07,260 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-977462392 given task: attempt_20131031182606197_0007_m_000002_0
2013-10-31 18:31:07,271 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1239478468 given task: attempt_20131031182606197_0007_m_000005_0
2013-10-31 18:31:07,274 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-1626281300 given task: attempt_20131031182606197_0007_m_000000_0
2013-10-31 18:31:07,313 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-1003825976 given task: attempt_20131031182606197_0007_m_000007_0
2013-10-31 18:31:07,810 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:31:07,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46950, bytes: 2129, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 195927
2013-10-31 18:31:07,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,832 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46952, bytes: 3161, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 171011
2013-10-31 18:31:07,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,844 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49582, bytes: 2129, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000004_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 169050
2013-10-31 18:31:07,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:31:07,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46955, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 132900
2013-10-31 18:31:07,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46954, bytes: 1613, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000005_0, offset: 1536, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 149000
2013-10-31 18:31:07,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,867 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49585, bytes: 1097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000006_0, offset: 2048, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 148092
2013-10-31 18:31:07,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:31:07,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,882 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46957, bytes: 2645, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 164735
2013-10-31 18:31:07,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 18:31:07,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:31:07,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:07,909 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46675, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000006_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 155727
2013-10-31 18:31:07,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42785, bytes: 1097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000007_0, offset: 2048, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2855333912159915853_1061, duration: 159382
2013-10-31 18:31:07,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 18:31:07,923 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46677, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000005_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-249196459070022847_1059, duration: 180115
2013-10-31 18:31:07,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:31:07,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2013-10-31 18:31:07,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42787, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000007_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-249196459070022847_1059, duration: 1596955
2013-10-31 18:31:08,143 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49591, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 147202
2013-10-31 18:31:08,150 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46963, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-249196459070022847_1059, duration: 121528
2013-10-31 18:31:08,192 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42790, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 154778
2013-10-31 18:31:08,290 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:31:08,292 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000001_0 is done.
2013-10-31 18:31:08,292 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000001_0  was 54
2013-10-31 18:31:08,292 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:09,828 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0007_m_000010_0
2013-10-31 18:31:09,829 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0007_m_000010_0
2013-10-31 18:31:09,829 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0007_m_000010_0 not found in cache
2013-10-31 18:31:10,735 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:31:10,739 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000003_0 is done.
2013-10-31 18:31:10,739 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000003_0  was 54
2013-10-31 18:31:10,740 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:10,756 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:31:10,758 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000000_0 is done.
2013-10-31 18:31:10,758 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000000_0  was 78
2013-10-31 18:31:10,758 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,769 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000004_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt:0+7
2013-10-31 18:31:10,771 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000004_0 is done.
2013-10-31 18:31:10,772 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000004_0  was 54
2013-10-31 18:31:10,772 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:10,777 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000005_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt:7+7
2013-10-31 18:31:10,778 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000005_0 is done.
2013-10-31 18:31:10,779 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000005_0  was 54
2013-10-31 18:31:10,779 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,791 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000006_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:31:10,792 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000006_0 is done.
2013-10-31 18:31:10,793 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000006_0  was 6
2013-10-31 18:31:10,793 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:10,803 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:31:10,805 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000002_0 is done.
2013-10-31 18:31:10,805 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000002_0  was 78
2013-10-31 18:31:10,805 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,830 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000000_0' has completed task_20131031182606197_0007_m_000000 successfully.
2013-10-31 18:31:10,831 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000001_0' has completed task_20131031182606197_0007_m_000001 successfully.
2013-10-31 18:31:10,833 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000008_0' to tip task_20131031182606197_0007_m_000008, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:10,833 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000008
2013-10-31 18:31:10,833 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0007_r_000000_0' to tip task_20131031182606197_0007_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000008_0 task's state:UNASSIGNED
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000008_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_r_000000_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000008_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_r_000000_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000007_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt:14+1
2013-10-31 18:31:10,837 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000007_0 is done.
2013-10-31 18:31:10,838 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000007_0  was 6
2013-10-31 18:31:10,839 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,857 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_r_629524259
2013-10-31 18:31:10,857 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_r_629524259 spawned.
2013-10-31 18:31:10,858 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0007/attempt_20131031182606197_0007_m_000008_0. Attempting to reuse: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:31:10,859 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_r_000000_0/taskjvm.sh
2013-10-31 18:31:10,861 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000002_0' has completed task_20131031182606197_0007_m_000002 successfully.
2013-10-31 18:31:11,217 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000003_0' has completed task_20131031182606197_0007_m_000003 successfully.
2013-10-31 18:31:11,220 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000006_0' has completed task_20131031182606197_0007_m_000006 successfully.
2013-10-31 18:31:11,222 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000007_0' has completed task_20131031182606197_0007_m_000007 successfully.
2013-10-31 18:31:11,225 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000004_0' has completed task_20131031182606197_0007_m_000004 successfully.
2013-10-31 18:31:11,227 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000005_0' has completed task_20131031182606197_0007_m_000005 successfully.
2013-10-31 18:31:11,810 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000008_0
2013-10-31 18:31:11,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split	dst=null	perm=null
2013-10-31 18:31:11,894 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46684, bytes: 581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000008_0, offset: 2560, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2855333912159915853_1061, duration: 166490
2013-10-31 18:31:11,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:31:11,898 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46685, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000008_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 100520
2013-10-31 18:31:12,016 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_r_629524259 given task: attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:14,869 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000008_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:31:14,873 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000008_0 is done.
2013-10-31 18:31:14,873 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000008_0  was 6
2013-10-31 18:31:14,873 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:16,842 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000008_0' has completed task_20131031182606197_0007_m_000008 successfully.
2013-10-31 18:31:17,689 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48636, bytes: 78, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000000_0, duration: 9942435
2013-10-31 18:31:17,715 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48636, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000001_0, duration: 12003031
2013-10-31 18:31:17,732 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38982, bytes: 78, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000002_0, duration: 12152067
2013-10-31 18:31:17,747 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38982, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000003_0, duration: 11611554
2013-10-31 18:31:17,765 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41004, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000006_0, duration: 12667798
2013-10-31 18:31:17,780 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41004, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000007_0, duration: 11613046
2013-10-31 18:31:17,797 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43681, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000004_0, duration: 12327733
2013-10-31 18:31:17,813 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43681, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000005_0, duration: 11706648
2013-10-31 18:31:18,498 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) > 
2013-10-31 18:31:20,038 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   8 OK for attempt_20131031182606197_0007_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:31:21,554 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) > 
2013-10-31 18:31:22,838 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48640, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000008_0, duration: 14414097
2013-10-31 18:31:23,561 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) > 
2013-10-31 18:31:23,616 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) > 
2013-10-31 18:31:23,820 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 345 Total time for transactions(ms): 8Number of transactions batched in Syncs: 13 Number of syncs: 235 SyncTimes(ms): 29582 9755 
2013-10-31 18:31:23,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:23,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:23,849 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000. blk_5160783804709220597_1067
2013-10-31 18:31:23,887 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5160783804709220597_1067 src: /127.0.0.1:42803 dest: /127.0.0.1:59471
2013-10-31 18:31:23,888 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5160783804709220597_1067 src: /127.0.0.1:46695 dest: /127.0.0.1:37740
2013-10-31 18:31:23,889 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5160783804709220597_1067 src: /127.0.0.1:49608 dest: /127.0.0.1:34578
2013-10-31 18:31:23,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49608, dest: /127.0.0.1:34578, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0007_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5160783804709220597_1067, duration: 1623032
2013-10-31 18:31:23,892 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5160783804709220597_1067 terminating
2013-10-31 18:31:23,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46695, dest: /127.0.0.1:37740, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0007_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5160783804709220597_1067, duration: 2723005
2013-10-31 18:31:23,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5160783804709220597_1067 terminating
2013-10-31 18:31:23,893 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42803, dest: /127.0.0.1:59471, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0007_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5160783804709220597_1067, duration: 3505618
2013-10-31 18:31:23,893 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5160783804709220597_1067 size 24
2013-10-31 18:31:23,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5160783804709220597_1067 terminating
2013-10-31 18:31:23,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5160783804709220597_1067 size 24
2013-10-31 18:31:23,896 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:23,896 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:23,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5160783804709220597_1067 size 24
2013-10-31 18:31:23,931 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0007_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:23,931 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) > 
2013-10-31 18:31:26,004 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 30
2013-10-31 18:31:26,046 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0007_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:31:26,047 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:26,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0	dst=null	perm=null
2013-10-31 18:31:26,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:26,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:27,601 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 18:31:30,651 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 18:31:33,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0	dst=null	perm=null
2013-10-31 18:31:33,657 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 18:31:33,660 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_r_000000_0 is done.
2013-10-31 18:31:33,660 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_r_000000_0  was -1
2013-10-31 18:31:33,661 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:35,058 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_r_000000_0' has completed task_20131031182606197_0007_r_000000 successfully.
2013-10-31 18:31:35,067 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0007_m_000009_0' to tip task_20131031182606197_0007_m_000009, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:35,069 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000009_0 task's state:UNASSIGNED
2013-10-31 18:31:35,070 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000009_0 which needs 1 slots
2013-10-31 18:31:35,070 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000009_0 which needs 1 slots
2013-10-31 18:31:35,104 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0007/attempt_20131031182606197_0007_m_000009_0. Attempting to reuse: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:31:36,298 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000009_0
2013-10-31 18:31:36,412 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000009_0 0.0% 
2013-10-31 18:31:36,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary	dst=null	perm=null
2013-10-31 18:31:36,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:36,428 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_SUCCESS from client DFSClient_attempt_20131031182606197_0007_m_000009_0
2013-10-31 18:31:36,428 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0007_m_000009_0
2013-10-31 18:31:36,432 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,432 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,432 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:36,432 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1355772319426900150 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1355772319426900150 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1355772319426900150 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6179045511188231419 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6179045511188231419 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:36,433 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6179045511188231419 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007	dst=null	perm=null
2013-10-31 18:31:37,383 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_7334543370624894983_1060 blk_2855333912159915853_1061 blk_6179045511188231419_1063
2013-10-31 18:31:37,383 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_7334543370624894983_1060 blk_-1355772319426900150_1062 blk_2855333912159915853_1061 blk_6179045511188231419_1063
2013-10-31 18:31:38,724 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1355772319426900150_1062 file build/test/data/dfs/data/data6/current/blk_-1355772319426900150 for deletion
2013-10-31 18:31:38,724 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data5/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:38,724 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1355772319426900150_1062 at file build/test/data/dfs/data/data6/current/blk_-1355772319426900150
2013-10-31 18:31:38,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data5/current/blk_2855333912159915853
2013-10-31 18:31:38,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6179045511188231419_1063 file build/test/data/dfs/data/data5/current/blk_6179045511188231419 for deletion
2013-10-31 18:31:38,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data6/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:38,725 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6179045511188231419_1063 at file build/test/data/dfs/data/data5/current/blk_6179045511188231419
2013-10-31 18:31:38,726 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data6/current/blk_7334543370624894983
2013-10-31 18:31:39,138 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data2/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:39,138 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6179045511188231419_1063 file build/test/data/dfs/data/data1/current/blk_6179045511188231419 for deletion
2013-10-31 18:31:39,138 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data2/current/blk_2855333912159915853
2013-10-31 18:31:39,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data1/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:39,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6179045511188231419_1063 at file build/test/data/dfs/data/data1/current/blk_6179045511188231419
2013-10-31 18:31:39,139 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data1/current/blk_7334543370624894983
2013-10-31 18:31:39,389 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000009_0 0.0% cleanup
2013-10-31 18:31:39,391 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000009_0 is done.
2013-10-31 18:31:39,391 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000009_0  was -1
2013-10-31 18:31:39,391 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:40,070 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:40,070 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:40,384 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_7334543370624894983_1060 blk_-1355772319426900150_1062 blk_2855333912159915853_1061
2013-10-31 18:31:40,384 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_7334543370624894983_1060 blk_-1355772319426900150_1062 blk_2855333912159915853_1061 blk_6179045511188231419_1063
2013-10-31 18:31:41,013 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1355772319426900150_1062 file build/test/data/dfs/data/data3/current/blk_-1355772319426900150 for deletion
2013-10-31 18:31:41,013 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data4/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:41,013 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1355772319426900150_1062 at file build/test/data/dfs/data/data3/current/blk_-1355772319426900150
2013-10-31 18:31:41,014 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6179045511188231419_1063 file build/test/data/dfs/data/data4/current/blk_6179045511188231419 for deletion
2013-10-31 18:31:41,014 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data4/current/blk_2855333912159915853
2013-10-31 18:31:41,014 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data3/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:41,014 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6179045511188231419_1063 at file build/test/data/dfs/data/data4/current/blk_6179045511188231419
2013-10-31 18:31:41,015 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data3/current/blk_7334543370624894983
2013-10-31 18:31:41,076 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000009_0' has completed task_20131031182606197_0007_m_000009 successfully.
2013-10-31 18:31:41,077 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0007 has completed successfully.
2013-10-31 18:31:41,077 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0007,submitTime=1383244256542,launchTime=1383244256676,firstMapTaskLaunchTime=1383244264823,firstReduceTaskLaunchTime=1383244270833,firstJobSetupTaskLaunchTime=1383244258808,firstJobCleanupTaskLaunchTime=1383244295067,finishTime=1383244301077,numMaps=9,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=57,reduceSlotsSeconds=22,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E0ECF75E124F455BBA40E7F3F5C3C75D/5FCF53C57E7E49A29505C93E4A8E34E7] merge/(1/1) ...platform/simplemergethree
2013-10-31 18:31:41,083 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2. blk_3514339520619960332_1068
2013-10-31 18:31:41,085 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3514339520619960332_1068 src: /127.0.0.1:46703 dest: /127.0.0.1:37740
2013-10-31 18:31:41,087 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3514339520619960332_1068 src: /127.0.0.1:49616 dest: /127.0.0.1:34578
2013-10-31 18:31:41,088 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3514339520619960332_1068 src: /127.0.0.1:42814 dest: /127.0.0.1:59471
2013-10-31 18:31:41,101 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42814, dest: /127.0.0.1:59471, bytes: 45910, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3514339520619960332_1068, duration: 7829400
2013-10-31 18:31:41,101 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3514339520619960332_1068 terminating
2013-10-31 18:31:41,102 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49616, dest: /127.0.0.1:34578, bytes: 45910, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3514339520619960332_1068, duration: 7000101
2013-10-31 18:31:41,102 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3514339520619960332_1068 terminating
2013-10-31 18:31:41,103 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46703, dest: /127.0.0.1:37740, bytes: 45910, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3514339520619960332_1068, duration: 10110119
2013-10-31 18:31:41,104 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3514339520619960332_1068 terminating
2013-10-31 18:31:41,110 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3514339520619960332_1068 size 45910
2013-10-31 18:31:41,111 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 from client DFSClient_314529799
2013-10-31 18:31:41,111 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 is closed by DFSClient_314529799
2013-10-31 18:31:41,112 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3514339520619960332_1068 size 45910
2013-10-31 18:31:41,112 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3514339520619960332_1068 size 45910
2013-10-31 18:31:41,118 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:31:41,118 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000000_0'
2013-10-31 18:31:41,118 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000001_0'
2013-10-31 18:31:41,118 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000008_0'
2013-10-31 18:31:41,119 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000009_0'
2013-10-31 18:31:41,119 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000010_0'
2013-10-31 18:31:41,119 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_r_000000_0'
2013-10-31 18:31:41,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8063380550776907754 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:41,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8063380550776907754 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:41,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8063380550776907754 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:41,123 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary
2013-10-31 18:31:41,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007	dst=null	perm=null
2013-10-31 18:31:41,126 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0007_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:31:41,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree	dst=null	perm=null
2013-10-31 18:31:41,172 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:31:41,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000	dst=null	perm=null
2013-10-31 18:31:41,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000	dst=null	perm=null
2013-10-31 18:31:41,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49619, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5160783804709220597_1067, duration: 132167
2013-10-31 18:31:41,176 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simplemergethree
2013-10-31 18:31:41,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree	dst=null	perm=null
2013-10-31 18:31:41,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000	dst=null	perm=null
2013-10-31 18:31:41,182 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46708, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5160783804709220597_1067, duration: 140059
2013-10-31 18:31:41,200 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:31:41,200 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:31:41,227 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting
2013-10-31 18:31:41,227 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:31:41,227 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1"]
2013-10-31 18:31:41,227 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2"]
2013-10-31 18:31:41,227 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  parallel execution is enabled: true
2013-10-31 18:31:41,228 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  starting jobs: 3
2013-10-31 18:31:41,228 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  allocating threads: 3
2013-10-31 18:31:41,229 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (1/3)
2013-10-31 18:31:41,236 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:31:41,236 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:31:41,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:41,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:31:41,249 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000002_0'
2013-10-31 18:31:41,249 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000003_0'
2013-10-31 18:31:41,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,256 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar. blk_-6615452559817063764_1069
2013-10-31 18:31:41,258 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:49621 dest: /127.0.0.1:34578
2013-10-31 18:31:41,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:46710 dest: /127.0.0.1:37740
2013-10-31 18:31:41,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:42820 dest: /127.0.0.1:59471
2013-10-31 18:31:41,267 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42820, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6615452559817063764_1069, duration: 5440178
2013-10-31 18:31:41,267 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6615452559817063764_1069 terminating
2013-10-31 18:31:41,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46710, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6615452559817063764_1069, duration: 5849556
2013-10-31 18:31:41,268 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6615452559817063764_1069 terminating
2013-10-31 18:31:41,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:41,269 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49621, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6615452559817063764_1069, duration: 6621527
2013-10-31 18:31:41,270 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:41,270 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6615452559817063764_1069 terminating
2013-10-31 18:31:41,271 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar from client DFSClient_-1596270109
2013-10-31 18:31:41,272 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:31:41,274 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:41,277 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar. New replication is 10
2013-10-31 18:31:41,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=null
2013-10-31 18:31:41,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,285 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:31:41,288 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000006_0'
2013-10-31 18:31:41,288 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000007_0'
2013-10-31 18:31:41,289 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000004_0'
2013-10-31 18:31:41,289 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000005_0'
2013-10-31 18:31:41,290 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:31:41,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:31:41,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,302 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split. New replication is 10
2013-10-31 18:31:41,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=null
2013-10-31 18:31:41,308 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split. blk_-5211779972710902284_1070
2013-10-31 18:31:41,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:46995 dest: /127.0.0.1:54365
2013-10-31 18:31:41,310 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:49625 dest: /127.0.0.1:34578
2013-10-31 18:31:41,311 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:42823 dest: /127.0.0.1:59471
2013-10-31 18:31:41,312 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:46715 dest: /127.0.0.1:37740
2013-10-31 18:31:41,315 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46715, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5211779972710902284_1070, duration: 547929
2013-10-31 18:31:41,315 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,316 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42823, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5211779972710902284_1070, duration: 1740433
2013-10-31 18:31:41,315 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,316 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,317 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49625, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5211779972710902284_1070, duration: 2627464
2013-10-31 18:31:41,317 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,318 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46995, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5211779972710902284_1070, duration: 3486682
2013-10-31 18:31:41,318 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,321 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,321 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split from client DFSClient_-1596270109
2013-10-31 18:31:41,322 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split is closed by DFSClient_-1596270109
2013-10-31 18:31:41,322 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,322 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,337 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo. blk_-8801034186855298322_1071
2013-10-31 18:31:41,338 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8801034186855298322_1071 src: /127.0.0.1:46716 dest: /127.0.0.1:37740
2013-10-31 18:31:41,340 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8801034186855298322_1071 src: /127.0.0.1:49629 dest: /127.0.0.1:34578
2013-10-31 18:31:41,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8801034186855298322_1071 src: /127.0.0.1:47001 dest: /127.0.0.1:54365
2013-10-31 18:31:41,344 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47001, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8801034186855298322_1071, duration: 431980
2013-10-31 18:31:41,344 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8801034186855298322_1071 terminating
2013-10-31 18:31:41,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49629, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8801034186855298322_1071, duration: 1636610
2013-10-31 18:31:41,345 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8801034186855298322_1071 terminating
2013-10-31 18:31:41,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46716, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8801034186855298322_1071, duration: 2399954
2013-10-31 18:31:41,346 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8801034186855298322_1071 terminating
2013-10-31 18:31:41,348 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8801034186855298322_1071 size 156
2013-10-31 18:31:41,348 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:31:41,348 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:31:41,349 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8801034186855298322_1071 size 156
2013-10-31 18:31:41,349 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8801034186855298322_1071 size 156
2013-10-31 18:31:42,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1355772319426900150_1062 file build/test/data/dfs/data/data8/current/blk_-1355772319426900150 for deletion
2013-10-31 18:31:42,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data7/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:42,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1355772319426900150_1062 at file build/test/data/dfs/data/data8/current/blk_-1355772319426900150
2013-10-31 18:31:42,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data8/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:42,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data7/current/blk_2855333912159915853
2013-10-31 18:31:42,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data8/current/blk_7334543370624894983
2013-10-31 18:31:43,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,063 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml. blk_2565033199268478674_1072
2013-10-31 18:31:43,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2565033199268478674_1072 src: /127.0.0.1:42828 dest: /127.0.0.1:59471
2013-10-31 18:31:43,067 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2565033199268478674_1072 src: /127.0.0.1:49632 dest: /127.0.0.1:34578
2013-10-31 18:31:43,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2565033199268478674_1072 src: /127.0.0.1:46721 dest: /127.0.0.1:37740
2013-10-31 18:31:43,074 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46721, dest: /127.0.0.1:37740, bytes: 27746, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2565033199268478674_1072, duration: 3235334
2013-10-31 18:31:43,075 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2565033199268478674_1072 terminating
2013-10-31 18:31:43,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49632, dest: /127.0.0.1:34578, bytes: 27746, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 4741626
2013-10-31 18:31:43,077 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2565033199268478674_1072 terminating
2013-10-31 18:31:43,078 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42828, dest: /127.0.0.1:59471, bytes: 27746, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2565033199268478674_1072, duration: 6392916
2013-10-31 18:31:43,078 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2565033199268478674_1072 size 27746
2013-10-31 18:31:43,078 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2565033199268478674_1072 terminating
2013-10-31 18:31:43,082 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2565033199268478674_1072 size 27746
2013-10-31 18:31:43,082 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml from client DFSClient_-1596270109
2013-10-31 18:31:43,083 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:31:43,083 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2565033199268478674_1072 size 27746
2013-10-31 18:31:43,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=null
2013-10-31 18:31:43,098 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49635, bytes: 27966, op: HDFS_READ, cliID: DFSClient_786869453, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 415553
2013-10-31 18:31:43,137 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0008: nMaps=4 nReduces=0 max=-1
2013-10-31 18:31:43,137 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0008 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:31:43,138 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0008
2013-10-31 18:31:43,138 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0008	RESULT=SUCCESS
2013-10-31 18:31:43,138 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0008
2013-10-31 18:31:43,139 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0008
2013-10-31 18:31:43,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,173 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml. blk_-2396101614590861125_1074
2013-10-31 18:31:43,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2396101614590861125_1074 src: /127.0.0.1:46724 dest: /127.0.0.1:37740
2013-10-31 18:31:43,177 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2396101614590861125_1074 src: /127.0.0.1:49637 dest: /127.0.0.1:34578
2013-10-31 18:31:43,179 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2396101614590861125_1074 src: /127.0.0.1:47009 dest: /127.0.0.1:54365
2013-10-31 18:31:43,185 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47009, dest: /127.0.0.1:54365, bytes: 27811, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2396101614590861125_1074, duration: 2732260
2013-10-31 18:31:43,185 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2396101614590861125_1074 terminating
2013-10-31 18:31:43,186 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49637, dest: /127.0.0.1:34578, bytes: 27811, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2396101614590861125_1074, duration: 3621707
2013-10-31 18:31:43,186 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2396101614590861125_1074 terminating
2013-10-31 18:31:43,187 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46724, dest: /127.0.0.1:37740, bytes: 27811, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2396101614590861125_1074, duration: 4475831
2013-10-31 18:31:43,187 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2396101614590861125_1074 terminating
2013-10-31 18:31:43,190 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2396101614590861125_1074 size 27811
2013-10-31 18:31:43,191 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml from client DFSClient_786869453
2013-10-31 18:31:43,191 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml is closed by DFSClient_786869453
2013-10-31 18:31:43,192 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2396101614590861125_1074 size 27811
2013-10-31 18:31:43,192 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2396101614590861125_1074 size 27811
2013-10-31 18:31:43,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,206 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken. blk_3249008124411573785_1075
2013-10-31 18:31:43,207 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3249008124411573785_1075 src: /127.0.0.1:46727 dest: /127.0.0.1:37740
2013-10-31 18:31:43,209 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3249008124411573785_1075 src: /127.0.0.1:42837 dest: /127.0.0.1:59471
2013-10-31 18:31:43,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3249008124411573785_1075 src: /127.0.0.1:49641 dest: /127.0.0.1:34578
2013-10-31 18:31:43,217 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49641, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3249008124411573785_1075, duration: 969181
2013-10-31 18:31:43,217 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3249008124411573785_1075 terminating
2013-10-31 18:31:43,219 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42837, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3249008124411573785_1075, duration: 2954813
2013-10-31 18:31:43,219 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3249008124411573785_1075 terminating
2013-10-31 18:31:43,220 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3249008124411573785_1075 size 116
2013-10-31 18:31:43,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46727, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3249008124411573785_1075, duration: 5236791
2013-10-31 18:31:43,221 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3249008124411573785_1075 size 116
2013-10-31 18:31:43,222 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3249008124411573785_1075 terminating
2013-10-31 18:31:43,225 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken from client DFSClient_-1596270109
2013-10-31 18:31:43,225 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:31:43,226 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3249008124411573785_1075 size 116
2013-10-31 18:31:43,229 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken
2013-10-31 18:31:43,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:31:43,234 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46730, bytes: 160, op: HDFS_READ, cliID: DFSClient_786869453, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8801034186855298322_1071, duration: 286256
2013-10-31 18:31:43,235 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0008 = 1449. Number of splits = 4
2013-10-31 18:31:43,235 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0008 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:31:43,239 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0008 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:31:43,385 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-6615452559817063764_1069 to datanode(s) 127.0.0.1:54365
2013-10-31 18:31:43,385 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-8063380550776907754_1066
2013-10-31 18:31:43,386 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-8063380550776907754_1066
2013-10-31 18:31:44,124 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0008_m_000005_0' to tip task_20131031182606197_0008_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:44,131 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:31:44,132 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000005_0 which needs 1 slots
2013-10-31 18:31:44,132 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000005_0 which needs 1 slots
2013-10-31 18:31:44,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken	dst=null	perm=null
2013-10-31 18:31:44,142 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42841, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3249008124411573785_1075, duration: 314454
2013-10-31 18:31:44,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=null
2013-10-31 18:31:44,153 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46734, bytes: 27966, op: HDFS_READ, cliID: DFSClient_3119137, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2565033199268478674_1072, duration: 394624
2013-10-31 18:31:44,185 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:44,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=null
2013-10-31 18:31:44,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42844, bytes: 239915, op: HDFS_READ, cliID: DFSClient_3119137, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6615452559817063764_1069, duration: 1409345
2013-10-31 18:31:44,321 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0007_m_-1626281300
2013-10-31 18:31:44,328 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20431 with signal TERM. Exit code 0
2013-10-31 18:31:44,328 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_966824357
2013-10-31 18:31:44,329 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_966824357 spawned.
2013-10-31 18:31:44,331 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000005_0/taskjvm.sh
2013-10-31 18:31:44,357 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0007_m_-1626281300
2013-10-31 18:31:44,726 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8063380550776907754_1066 file build/test/data/dfs/data/data5/current/blk_-8063380550776907754 for deletion
2013-10-31 18:31:44,726 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8063380550776907754_1066 at file build/test/data/dfs/data/data5/current/blk_-8063380550776907754
2013-10-31 18:31:45,140 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-6615452559817063764_1069 to 127.0.0.1:54365 
2013-10-31 18:31:45,142 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:47019 dest: /127.0.0.1:54365
2013-10-31 18:31:45,143 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-6615452559817063764_1069 to /127.0.0.1:54365
2013-10-31 18:31:45,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-6615452559817063764_1069 src: /127.0.0.1:47019 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:31:45,150 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:45,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8063380550776907754_1066 file build/test/data/dfs/data/data8/current/blk_-8063380550776907754 for deletion
2013-10-31 18:31:45,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8063380550776907754_1066 at file build/test/data/dfs/data/data8/current/blk_-8063380550776907754
2013-10-31 18:31:45,686 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:45,686 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:45,686 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:45,686 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-1626281300 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:46,119 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,120 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0007_m_000009_0 not found in cache
2013-10-31 18:31:46,121 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706121
2013-10-31 18:31:46,213 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_r_629524259 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:46,223 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20858 with signal TERM. Exit code 0
2013-10-31 18:31:46,250 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,251 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706251
2013-10-31 18:31:46,288 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,289 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706289
2013-10-31 18:31:46,290 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,290 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706290
2013-10-31 18:31:46,298 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_966824357 given task: attempt_20131031182606197_0008_m_000005_0
2013-10-31 18:31:46,374 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:46,374 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:46,374 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:46,374 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_r_629524259 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:46,386 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-8063380550776907754_1066
2013-10-31 18:31:46,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:47,326 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_-1489999599 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,336 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20432 with signal TERM. Exit code 0
2013-10-31 18:31:47,347 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1064165913 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,359 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20441 with signal TERM. Exit code 0
2013-10-31 18:31:47,360 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1239478468 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,368 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1599992582 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,380 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_-977462392 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,382 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20439 with signal TERM. Exit code 0
2013-10-31 18:31:47,387 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20440 with signal TERM. Exit code 0
2013-10-31 18:31:47,403 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20430 with signal TERM. Exit code 0
2013-10-31 18:31:47,428 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1975138276 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,434 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20210 with signal TERM. Exit code 0
2013-10-31 18:31:47,579 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,580 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,580 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:47,580 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1064165913 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,606 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,606 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,606 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:47,606 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-977462392 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,609 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,609 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,609 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:47,609 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-1489999599 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,610 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,610 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,610 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:47,610 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1975138276 exited with exit code 143. Number of tasks it ran: 4
2013-10-31 18:31:47,613 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,613 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,613 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:47,613 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1599992582 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,615 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,615 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,616 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:47,616 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1239478468 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,744 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_-1003825976 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,753 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20442 with signal TERM. Exit code 0
2013-10-31 18:31:48,002 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:48,002 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:48,002 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:31:48,003 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-1003825976 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:48,141 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8063380550776907754_1066 file build/test/data/dfs/data/data2/current/blk_-8063380550776907754 for deletion
2013-10-31 18:31:48,141 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8063380550776907754_1066 at file build/test/data/dfs/data/data2/current/blk_-8063380550776907754
2013-10-31 18:31:49,736 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000005_0 0.0% setup
2013-10-31 18:31:49,739 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000005_0 is done.
2013-10-31 18:31:49,739 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000005_0  was -1
2013-10-31 18:31:49,739 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:50,138 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000005_0' has completed task_20131031182606197_0008_m_000005 successfully.
2013-10-31 18:31:50,142 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000000_0' to tip task_20131031182606197_0008_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:50,143 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000000
2013-10-31 18:31:50,144 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:31:50,145 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000000_0 which needs 1 slots
2013-10-31 18:31:50,145 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000000_0 which needs 1 slots
2013-10-31 18:31:50,181 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_-753643868
2013-10-31 18:31:50,182 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_-753643868 spawned.
2013-10-31 18:31:50,184 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000000_0/taskjvm.sh
2013-10-31 18:31:50,259 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000001_0' to tip task_20131031182606197_0008_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:31:50,259 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000001
2013-10-31 18:31:50,261 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:31:50,261 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000001_0 which needs 1 slots
2013-10-31 18:31:50,261 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000001_0 which needs 1 slots
2013-10-31 18:31:50,295 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000002_0' to tip task_20131031182606197_0008_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:31:50,296 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000002
2013-10-31 18:31:50,297 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:31:50,297 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000002_0 which needs 1 slots
2013-10-31 18:31:50,297 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000002_0 which needs 1 slots
2013-10-31 18:31:50,298 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000003_0' to tip task_20131031182606197_0008_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:31:50,298 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000003
2013-10-31 18:31:50,300 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:31:50,300 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000003_0 which needs 1 slots
2013-10-31 18:31:50,300 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000003_0 which needs 1 slots
2013-10-31 18:31:50,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken	dst=null	perm=null
2013-10-31 18:31:50,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken	dst=null	perm=null
2013-10-31 18:31:50,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken	dst=null	perm=null
2013-10-31 18:31:50,604 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49651, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3249008124411573785_1075, duration: 304550
2013-10-31 18:31:50,605 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46740, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3249008124411573785_1075, duration: 384960
2013-10-31 18:31:50,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=null
2013-10-31 18:31:50,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=null
2013-10-31 18:31:50,617 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49655, bytes: 27966, op: HDFS_READ, cliID: DFSClient_1644234686, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 410485
2013-10-31 18:31:50,617 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49656, bytes: 27966, op: HDFS_READ, cliID: DFSClient_-245661260, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 419555
2013-10-31 18:31:50,641 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49657, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3249008124411573785_1075, duration: 276762
2013-10-31 18:31:50,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml	dst=null	perm=null
2013-10-31 18:31:50,646 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42856, bytes: 27966, op: HDFS_READ, cliID: DFSClient_1145407818, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2565033199268478674_1072, duration: 391729
2013-10-31 18:31:50,664 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:50,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=null
2013-10-31 18:31:50,692 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42857, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1145407818, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6615452559817063764_1069, duration: 1292422
2013-10-31 18:31:50,773 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_-1990778351
2013-10-31 18:31:50,774 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_-1990778351 spawned.
2013-10-31 18:31:50,776 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000002_0/taskjvm.sh
2013-10-31 18:31:50,886 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:50,886 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:50,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=null
2013-10-31 18:31:50,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46749, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-245661260, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6615452559817063764_1069, duration: 1327501
2013-10-31 18:31:50,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar	dst=null	perm=null
2013-10-31 18:31:50,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49662, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1644234686, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6615452559817063764_1069, duration: 1635618
2013-10-31 18:31:51,727 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_-753643868 given task: attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:52,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=null
2013-10-31 18:31:52,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46753, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5211779972710902284_1070, duration: 216739
2013-10-31 18:31:52,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:31:52,252 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46754, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 265065
2013-10-31 18:31:52,755 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_1577226638
2013-10-31 18:31:52,755 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_1411612696
2013-10-31 18:31:52,756 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_1577226638 spawned.
2013-10-31 18:31:52,756 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_1411612696 spawned.
2013-10-31 18:31:52,757 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000003_0/taskjvm.sh
2013-10-31 18:31:52,758 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000001_0/taskjvm.sh
2013-10-31 18:31:53,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:53,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:54,152 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_-1990778351 given task: attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:54,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=null
2013-10-31 18:31:54,652 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46758, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5211779972710902284_1070, duration: 207630
2013-10-31 18:31:54,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:31:54,691 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47042, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 370402
2013-10-31 18:31:55,145 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0008_m_000005_0
2013-10-31 18:31:55,145 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0008_m_000005_0
2013-10-31 18:31:55,145 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000005_0 not found in cache
2013-10-31 18:31:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:31:56,020 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,025 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,031 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,036 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,042 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,047 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:31:56,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:56,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:56,757 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000. blk_7738361136727118235_1077
2013-10-31 18:31:56,779 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7738361136727118235_1077 src: /127.0.0.1:42869 dest: /127.0.0.1:59471
2013-10-31 18:31:56,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7738361136727118235_1077 src: /127.0.0.1:49673 dest: /127.0.0.1:34578
2013-10-31 18:31:56,782 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002. blk_7731653809023951984_1077
2013-10-31 18:31:56,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7731653809023951984_1077 src: /127.0.0.1:46762 dest: /127.0.0.1:37740
2013-10-31 18:31:56,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7731653809023951984_1077 src: /127.0.0.1:42872 dest: /127.0.0.1:59471
2013-10-31 18:31:56,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7731653809023951984_1077 src: /127.0.0.1:49676 dest: /127.0.0.1:34578
2013-10-31 18:31:56,953 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7738361136727118235_1077 src: /127.0.0.1:46765 dest: /127.0.0.1:37740
2013-10-31 18:31:56,962 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49676, dest: /127.0.0.1:34578, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7731653809023951984_1077, duration: 8795253
2013-10-31 18:31:56,964 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7731653809023951984_1077 terminating
2013-10-31 18:31:56,965 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46765, dest: /127.0.0.1:37740, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7738361136727118235_1077, duration: 6599534
2013-10-31 18:31:56,965 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42872, dest: /127.0.0.1:59471, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7731653809023951984_1077, duration: 12098144
2013-10-31 18:31:56,966 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7738361136727118235_1077 terminating
2013-10-31 18:31:56,967 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7731653809023951984_1077 terminating
2013-10-31 18:31:56,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49673, dest: /127.0.0.1:34578, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7738361136727118235_1077, duration: 7176237
2013-10-31 18:31:56,970 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46762, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7731653809023951984_1077, duration: 16522125
2013-10-31 18:31:56,970 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7738361136727118235_1077 terminating
2013-10-31 18:31:56,972 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7731653809023951984_1077 terminating
2013-10-31 18:31:56,972 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42869, dest: /127.0.0.1:59471, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7738361136727118235_1077, duration: 11425124
2013-10-31 18:31:56,970 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7731653809023951984_1077 size 70
2013-10-31 18:31:56,972 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7738361136727118235_1077 terminating
2013-10-31 18:31:56,973 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7731653809023951984_1077 size 70
2013-10-31 18:31:56,974 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:56,974 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:56,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7738361136727118235_1077 size 260
2013-10-31 18:31:56,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7738361136727118235_1077 size 260
2013-10-31 18:31:56,976 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7738361136727118235_1077 size 260
2013-10-31 18:31:56,976 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7731653809023951984_1077 size 70
2013-10-31 18:31:56,978 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:56,978 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:57,025 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:57,025 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000002_0 0.0% 
2013-10-31 18:31:57,062 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:57,062 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 0.0% 
2013-10-31 18:31:57,744 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_1411612696 given task: attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:31:57,745 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_1577226638 given task: attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:31:58,182 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:31:58,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=null
2013-10-31 18:31:58,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47053, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5211779972710902284_1070, duration: 137705
2013-10-31 18:31:58,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split	dst=null	perm=null
2013-10-31 18:31:58,259 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42880, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5211779972710902284_1070, duration: 205363
2013-10-31 18:31:58,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:31:58,287 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49684, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 155938
2013-10-31 18:31:58,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:31:58,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:58,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:59,156 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:59,303 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:59,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:59,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:59,901 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49685, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 179146
2013-10-31 18:31:59,902 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003. blk_4349690085078030343_1079
2013-10-31 18:31:59,905 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001. blk_-257311796089327943_1079
2013-10-31 18:31:59,925 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4349690085078030343_1079 src: /127.0.0.1:42883 dest: /127.0.0.1:59471
2013-10-31 18:31:59,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4349690085078030343_1079 src: /127.0.0.1:49688 dest: /127.0.0.1:34578
2013-10-31 18:31:59,927 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4349690085078030343_1079 src: /127.0.0.1:46777 dest: /127.0.0.1:37740
2013-10-31 18:31:59,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-257311796089327943_1079 src: /127.0.0.1:49687 dest: /127.0.0.1:34578
2013-10-31 18:31:59,930 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46777, dest: /127.0.0.1:37740, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4349690085078030343_1079, duration: 1678834
2013-10-31 18:31:59,930 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4349690085078030343_1079 terminating
2013-10-31 18:31:59,931 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49688, dest: /127.0.0.1:34578, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4349690085078030343_1079, duration: 2399795
2013-10-31 18:31:59,931 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4349690085078030343_1079 terminating
2013-10-31 18:31:59,931 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-257311796089327943_1079 src: /127.0.0.1:47061 dest: /127.0.0.1:54365
2013-10-31 18:31:59,931 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42883, dest: /127.0.0.1:59471, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4349690085078030343_1079, duration: 3382229
2013-10-31 18:31:59,932 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4349690085078030343_1079 terminating
2013-10-31 18:31:59,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-257311796089327943_1079 src: /127.0.0.1:46779 dest: /127.0.0.1:37740
2013-10-31 18:31:59,934 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4349690085078030343_1079 size 260
2013-10-31 18:31:59,935 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4349690085078030343_1079 size 260
2013-10-31 18:31:59,935 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46779, dest: /127.0.0.1:37740, bytes: 214, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-257311796089327943_1079, duration: 1530605
2013-10-31 18:31:59,935 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-257311796089327943_1079 terminating
2013-10-31 18:31:59,935 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4349690085078030343_1079 size 260
2013-10-31 18:31:59,935 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47061, dest: /127.0.0.1:54365, bytes: 214, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-257311796089327943_1079, duration: 2279119
2013-10-31 18:31:59,936 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-257311796089327943_1079 size 214
2013-10-31 18:31:59,936 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-257311796089327943_1079 terminating
2013-10-31 18:31:59,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49687, dest: /127.0.0.1:34578, bytes: 214, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-257311796089327943_1079, duration: 3116971
2013-10-31 18:31:59,936 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-257311796089327943_1079 terminating
2013-10-31 18:31:59,937 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-257311796089327943_1079 size 214
2013-10-31 18:31:59,937 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:31:59,937 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:31:59,941 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-257311796089327943_1079 size 214
2013-10-31 18:31:59,982 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:59,983 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000001_0 0.0% 
2013-10-31 18:32:00,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0	dst=null	perm=null
2013-10-31 18:32:00,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:00,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:00,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0	dst=null	perm=null
2013-10-31 18:32:00,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0	dst=null	perm=null
2013-10-31 18:32:00,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:00,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:00,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0	dst=null	perm=null
2013-10-31 18:32:00,334 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:32:00,335 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:32:00,392 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:00,392 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000003_0 0.0% 
2013-10-31 18:32:00,613 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:32:00,616 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:32:00,617 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000002_0 is done.
2013-10-31 18:32:00,618 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000002_0  was -1
2013-10-31 18:32:00,618 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:01,264 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:32:01,266 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:32:01,267 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000000_0 is done.
2013-10-31 18:32:01,267 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000000_0  was -1
2013-10-31 18:32:01,267 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:02,160 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000000_0' has completed task_20131031182606197_0008_m_000000 successfully.
2013-10-31 18:32:02,272 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:32:02,307 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000002_0' has completed task_20131031182606197_0008_m_000002 successfully.
2013-10-31 18:32:02,309 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:32:02,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0	dst=null	perm=null
2013-10-31 18:32:02,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:02,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:02,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0	dst=null	perm=null
2013-10-31 18:32:02,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0	dst=null	perm=null
2013-10-31 18:32:02,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:03,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:03,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0	dst=null	perm=null
2013-10-31 18:32:04,207 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:32:04,209 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:32:04,209 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000003_0 is done.
2013-10-31 18:32:04,209 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000003_0  was -1
2013-10-31 18:32:04,210 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:04,224 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:32:04,226 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:32:04,226 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000001_0 is done.
2013-10-31 18:32:04,227 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000001_0  was -1
2013-10-31 18:32:04,227 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:05,275 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000001_0' has completed task_20131031182606197_0008_m_000001 successfully.
2013-10-31 18:32:05,312 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000003_0' has completed task_20131031182606197_0008_m_000003 successfully.
2013-10-31 18:32:05,317 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0008_m_000004_0' to tip task_20131031182606197_0008_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:05,319 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:32:05,319 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000004_0 which needs 1 slots
2013-10-31 18:32:05,320 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000004_0 which needs 1 slots
2013-10-31 18:32:05,358 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_775790396
2013-10-31 18:32:05,358 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_775790396 spawned.
2013-10-31 18:32:05,361 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000004_0/taskjvm.sh
2013-10-31 18:32:06,608 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_775790396 given task: attempt_20131031182606197_0008_m_000004_0
2013-10-31 18:32:07,094 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000004_0 0.0% 
2013-10-31 18:32:07,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary	dst=null	perm=null
2013-10-31 18:32:07,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:07,113 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_SUCCESS from client DFSClient_attempt_20131031182606197_0008_m_000004_0
2013-10-31 18:32:07,114 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0008_m_000004_0
2013-10-31 18:32:07,117 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:07,117 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:07,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8801034186855298322 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8801034186855298322 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8801034186855298322 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:07,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2565033199268478674 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2565033199268478674 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:07,119 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2565033199268478674 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008	dst=null	perm=null
2013-10-31 18:32:07,391 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-5211779972710902284_1070 blk_-8801034186855298322_1071 blk_-6615452559817063764_1069
2013-10-31 18:32:07,391 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-5211779972710902284_1070 blk_-8801034186855298322_1071 blk_2565033199268478674_1072 blk_-6615452559817063764_1069
2013-10-31 18:32:08,022 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8801034186855298322_1071 file build/test/data/dfs/data/data3/current/blk_-8801034186855298322 for deletion
2013-10-31 18:32:08,022 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data3/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:08,022 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8801034186855298322_1071 at file build/test/data/dfs/data/data3/current/blk_-8801034186855298322
2013-10-31 18:32:08,023 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data4/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:08,023 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data3/current/blk_-6615452559817063764
2013-10-31 18:32:08,023 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data4/current/blk_-5211779972710902284
2013-10-31 18:32:09,221 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8801034186855298322_1071 file build/test/data/dfs/data/data7/current/blk_-8801034186855298322 for deletion
2013-10-31 18:32:09,221 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data7/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:09,221 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8801034186855298322_1071 at file build/test/data/dfs/data/data7/current/blk_-8801034186855298322
2013-10-31 18:32:09,221 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data8/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:09,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2565033199268478674_1072 file build/test/data/dfs/data/data8/current/blk_2565033199268478674 for deletion
2013-10-31 18:32:09,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data8/current/blk_-5211779972710902284
2013-10-31 18:32:09,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data7/current/blk_-6615452559817063764
2013-10-31 18:32:09,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2565033199268478674_1072 at file build/test/data/dfs/data/data8/current/blk_2565033199268478674
2013-10-31 18:32:10,029 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000004_0 0.0% cleanup
2013-10-31 18:32:10,031 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000004_0 is done.
2013-10-31 18:32:10,031 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000004_0  was -1
2013-10-31 18:32:10,031 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:10,391 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-5211779972710902284_1070 blk_-8801034186855298322_1071 blk_2565033199268478674_1072 blk_-6615452559817063764_1069
2013-10-31 18:32:10,392 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-5211779972710902284_1070 blk_2565033199268478674_1072 blk_-6615452559817063764_1069
2013-10-31 18:32:11,327 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000004_0' has completed task_20131031182606197_0008_m_000004 successfully.
2013-10-31 18:32:11,328 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0008 has completed successfully.
2013-10-31 18:32:11,329 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0008,submitTime=1383244303088,launchTime=1383244303239,firstMapTaskLaunchTime=1383244310141,firstJobSetupTaskLaunchTime=1383244304123,firstJobCleanupTaskLaunchTime=1383244325316,finishTime=1383244331328,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=54,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3CB815650E6B4FC3B298C6C9B575DB86/537D50CF9A3B40BCBDC85E14863FF241] left+right/(1/3)
2013-10-31 18:32:11,335 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC. blk_-8232283085439151097_1080
2013-10-31 18:32:11,336 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8232283085439151097_1080 src: /127.0.0.1:42892 dest: /127.0.0.1:59471
2013-10-31 18:32:11,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8232283085439151097_1080 src: /127.0.0.1:47067 dest: /127.0.0.1:54365
2013-10-31 18:32:11,338 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8232283085439151097_1080 src: /127.0.0.1:46785 dest: /127.0.0.1:37740
2013-10-31 18:32:11,351 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46785, dest: /127.0.0.1:37740, bytes: 22431, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8232283085439151097_1080, duration: 11515230
2013-10-31 18:32:11,352 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8232283085439151097_1080 terminating
2013-10-31 18:32:11,353 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47067, dest: /127.0.0.1:54365, bytes: 22431, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8232283085439151097_1080, duration: 3447460
2013-10-31 18:32:11,353 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8232283085439151097_1080 terminating
2013-10-31 18:32:11,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42892, dest: /127.0.0.1:59471, bytes: 22431, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8232283085439151097_1080, duration: 14366345
2013-10-31 18:32:11,354 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8232283085439151097_1080 size 22431
2013-10-31 18:32:11,354 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8232283085439151097_1080 terminating
2013-10-31 18:32:11,357 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC from client DFSClient_786869453
2013-10-31 18:32:11,357 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC is closed by DFSClient_786869453
2013-10-31 18:32:11,357 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8232283085439151097_1080 size 22431
2013-10-31 18:32:11,358 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8232283085439151097_1080 size 22431
2013-10-31 18:32:11,362 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:11,363 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000003_0'
2013-10-31 18:32:11,363 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000004_0'
2013-10-31 18:32:11,363 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3249008124411573785 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:11,363 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3249008124411573785 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:11,363 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3249008124411573785 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:11,367 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0008_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:11,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008	dst=null	perm=null
2013-10-31 18:32:11,368 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (2/3) ...pesplatform/nonsafesplit2
2013-10-31 18:32:11,368 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (3/3) ...pesplatform/nonsafesplit1
2013-10-31 18:32:11,372 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:32:11,372 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:32:11,372 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:32:11,372 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:32:11,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:11,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:11,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:32:11,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:32:11,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,520 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar. blk_1765133373633960270_1082
2013-10-31 18:32:11,521 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:49699 dest: /127.0.0.1:34578
2013-10-31 18:32:11,522 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:47071 dest: /127.0.0.1:54365
2013-10-31 18:32:11,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,522 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:46789 dest: /127.0.0.1:37740
2013-10-31 18:32:11,553 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46789, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1765133373633960270_1082, duration: 27449484
2013-10-31 18:32:11,554 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1765133373633960270_1082 terminating
2013-10-31 18:32:11,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47071, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1765133373633960270_1082, duration: 29183615
2013-10-31 18:32:11,556 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1765133373633960270_1082 terminating
2013-10-31 18:32:11,557 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49699, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1765133373633960270_1082, duration: 31447632
2013-10-31 18:32:11,558 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:11,558 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1765133373633960270_1082 terminating
2013-10-31 18:32:11,561 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:11,561 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar from client DFSClient_-1596270109
2013-10-31 18:32:11,562 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:32:11,562 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:11,567 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar. blk_-4134747532649829860_1082
2013-10-31 18:32:11,568 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar. New replication is 10
2013-10-31 18:32:11,569 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:46790 dest: /127.0.0.1:37740
2013-10-31 18:32:11,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:42900 dest: /127.0.0.1:59471
2013-10-31 18:32:11,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar	dst=null	perm=null
2013-10-31 18:32:11,572 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:49704 dest: /127.0.0.1:34578
2013-10-31 18:32:11,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,588 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:32:11,594 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49704, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4134747532649829860_1082, duration: 19885564
2013-10-31 18:32:11,595 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4134747532649829860_1082 terminating
2013-10-31 18:32:11,597 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:11,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42900, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4134747532649829860_1082, duration: 21878435
2013-10-31 18:32:11,598 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:11,600 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4134747532649829860_1082 terminating
2013-10-31 18:32:11,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=null
2013-10-31 18:32:11,604 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46790, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4134747532649829860_1082, duration: 18069065
2013-10-31 18:32:11,604 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4134747532649829860_1082 terminating
2013-10-31 18:32:11,612 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:11,613 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar from client DFSClient_-1596270109
2013-10-31 18:32:11,613 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:32:11,614 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:11,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000	dst=null	perm=null
2013-10-31 18:32:11,617 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar. New replication is 10
2013-10-31 18:32:11,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=null
2013-10-31 18:32:11,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001	dst=null	perm=null
2013-10-31 18:32:11,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,627 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:32:11,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002	dst=null	perm=null
2013-10-31 18:32:11,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003	dst=null	perm=null
2013-10-31 18:32:11,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=null
2013-10-31 18:32:11,634 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:11,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000	dst=null	perm=null
2013-10-31 18:32:11,639 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split. New replication is 10
2013-10-31 18:32:11,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=null
2013-10-31 18:32:11,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001	dst=null	perm=null
2013-10-31 18:32:11,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002	dst=null	perm=null
2013-10-31 18:32:11,645 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split. blk_7445994968599272333_1083
2013-10-31 18:32:11,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003	dst=null	perm=null
2013-10-31 18:32:11,646 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:47076 dest: /127.0.0.1:54365
2013-10-31 18:32:11,647 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:42903 dest: /127.0.0.1:59471
2013-10-31 18:32:11,648 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:49707 dest: /127.0.0.1:34578
2013-10-31 18:32:11,649 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:46796 dest: /127.0.0.1:37740
2013-10-31 18:32:11,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,653 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46796, dest: /127.0.0.1:37740, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7445994968599272333_1083, duration: 723900
2013-10-31 18:32:11,653 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,655 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49707, dest: /127.0.0.1:34578, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7445994968599272333_1083, duration: 1741919
2013-10-31 18:32:11,655 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,656 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42903, dest: /127.0.0.1:59471, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7445994968599272333_1083, duration: 3313294
2013-10-31 18:32:11,656 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,656 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,657 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47076, dest: /127.0.0.1:54365, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7445994968599272333_1083, duration: 4717371
2013-10-31 18:32:11,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,658 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,657 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,660 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,660 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split from client DFSClient_-1596270109
2013-10-31 18:32:11,660 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split is closed by DFSClient_-1596270109
2013-10-31 18:32:11,661 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,666 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split. New replication is 10
2013-10-31 18:32:11,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=null
2013-10-31 18:32:11,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,677 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split. blk_-8036407782984700833_1085
2013-10-31 18:32:11,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:49709 dest: /127.0.0.1:34578
2013-10-31 18:32:11,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:47081 dest: /127.0.0.1:54365
2013-10-31 18:32:11,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:42908 dest: /127.0.0.1:59471
2013-10-31 18:32:11,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:46800 dest: /127.0.0.1:37740
2013-10-31 18:32:11,684 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo. blk_-4081485762383124586_1085
2013-10-31 18:32:11,687 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4081485762383124586_1085 src: /127.0.0.1:42910 dest: /127.0.0.1:59471
2013-10-31 18:32:11,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46800, dest: /127.0.0.1:37740, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036407782984700833_1085, duration: 946166
2013-10-31 18:32:11,689 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,690 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42908, dest: /127.0.0.1:59471, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8036407782984700833_1085, duration: 2550085
2013-10-31 18:32:11,691 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4081485762383124586_1085 src: /127.0.0.1:47085 dest: /127.0.0.1:54365
2013-10-31 18:32:11,691 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47081, dest: /127.0.0.1:54365, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8036407782984700833_1085, duration: 4594248
2013-10-31 18:32:11,693 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,694 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,694 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49709, dest: /127.0.0.1:34578, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036407782984700833_1085, duration: 6622570
2013-10-31 18:32:11,695 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,695 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,697 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4081485762383124586_1085 src: /127.0.0.1:46803 dest: /127.0.0.1:37740
2013-10-31 18:32:11,697 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,700 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,701 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split from client DFSClient_-1596270109
2013-10-31 18:32:11,701 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split is closed by DFSClient_-1596270109
2013-10-31 18:32:11,706 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46803, dest: /127.0.0.1:37740, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4081485762383124586_1085, duration: 942881
2013-10-31 18:32:11,706 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4081485762383124586_1085 terminating
2013-10-31 18:32:11,707 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4081485762383124586_1085 size 153
2013-10-31 18:32:11,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47085, dest: /127.0.0.1:54365, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4081485762383124586_1085, duration: 2978454
2013-10-31 18:32:11,708 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4081485762383124586_1085 size 153
2013-10-31 18:32:11,708 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4081485762383124586_1085 terminating
2013-10-31 18:32:11,711 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42910, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4081485762383124586_1085, duration: 5943933
2013-10-31 18:32:11,712 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4081485762383124586_1085 terminating
2013-10-31 18:32:11,715 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4081485762383124586_1085 size 153
2013-10-31 18:32:11,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,718 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:32:11,719 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:32:11,752 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data6/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:11,752 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data5/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:11,752 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data6/current/blk_-6615452559817063764
2013-10-31 18:32:11,753 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2565033199268478674_1072 file build/test/data/dfs/data/data6/current/blk_2565033199268478674 for deletion
2013-10-31 18:32:11,753 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data5/current/blk_-5211779972710902284
2013-10-31 18:32:11,753 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2565033199268478674_1072 at file build/test/data/dfs/data/data6/current/blk_2565033199268478674
2013-10-31 18:32:12,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8801034186855298322_1071 file build/test/data/dfs/data/data2/current/blk_-8801034186855298322 for deletion
2013-10-31 18:32:12,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data2/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:12,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8801034186855298322_1071 at file build/test/data/dfs/data/data2/current/blk_-8801034186855298322
2013-10-31 18:32:12,149 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data1/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:12,150 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data2/current/blk_-6615452559817063764
2013-10-31 18:32:12,150 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data1/current/blk_-5211779972710902284
2013-10-31 18:32:12,150 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2565033199268478674_1072 file build/test/data/dfs/data/data1/current/blk_2565033199268478674 for deletion
2013-10-31 18:32:12,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2565033199268478674_1072 at file build/test/data/dfs/data/data1/current/blk_2565033199268478674
2013-10-31 18:32:13,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,206 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo. blk_-6246259349516176919_1087
2013-10-31 18:32:13,207 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6246259349516176919_1087 src: /127.0.0.1:42913 dest: /127.0.0.1:59471
2013-10-31 18:32:13,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,209 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6246259349516176919_1087 src: /127.0.0.1:46805 dest: /127.0.0.1:37740
2013-10-31 18:32:13,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6246259349516176919_1087 src: /127.0.0.1:49718 dest: /127.0.0.1:34578
2013-10-31 18:32:13,215 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49718, dest: /127.0.0.1:34578, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6246259349516176919_1087, duration: 1031960
2013-10-31 18:32:13,215 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6246259349516176919_1087 terminating
2013-10-31 18:32:13,217 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46805, dest: /127.0.0.1:37740, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6246259349516176919_1087, duration: 2800464
2013-10-31 18:32:13,217 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6246259349516176919_1087 terminating
2013-10-31 18:32:13,219 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42913, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6246259349516176919_1087, duration: 4930614
2013-10-31 18:32:13,219 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6246259349516176919_1087 size 153
2013-10-31 18:32:13,220 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6246259349516176919_1087 terminating
2013-10-31 18:32:13,221 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6246259349516176919_1087 size 153
2013-10-31 18:32:13,222 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:32:13,222 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:32:13,224 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6246259349516176919_1087 size 153
2013-10-31 18:32:13,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,238 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml. blk_-4993244343269496237_1088
2013-10-31 18:32:13,240 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4993244343269496237_1088 src: /127.0.0.1:47090 dest: /127.0.0.1:54365
2013-10-31 18:32:13,242 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4993244343269496237_1088 src: /127.0.0.1:49720 dest: /127.0.0.1:34578
2013-10-31 18:32:13,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,244 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4993244343269496237_1088 src: /127.0.0.1:46809 dest: /127.0.0.1:37740
2013-10-31 18:32:13,248 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46809, dest: /127.0.0.1:37740, bytes: 27817, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4993244343269496237_1088, duration: 864255
2013-10-31 18:32:13,248 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4993244343269496237_1088 terminating
2013-10-31 18:32:13,249 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49720, dest: /127.0.0.1:34578, bytes: 27817, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4993244343269496237_1088, duration: 2366174
2013-10-31 18:32:13,250 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4993244343269496237_1088 terminating
2013-10-31 18:32:13,251 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47090, dest: /127.0.0.1:54365, bytes: 27817, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4993244343269496237_1088, duration: 3962291
2013-10-31 18:32:13,251 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4993244343269496237_1088 terminating
2013-10-31 18:32:13,253 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4993244343269496237_1088 size 27817
2013-10-31 18:32:13,253 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml from client DFSClient_-1596270109
2013-10-31 18:32:13,254 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:32:13,254 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4993244343269496237_1088 size 27817
2013-10-31 18:32:13,256 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4993244343269496237_1088 size 27817
2013-10-31 18:32:13,260 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml. blk_3808353552338567285_1088
2013-10-31 18:32:13,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml	dst=null	perm=null
2013-10-31 18:32:13,270 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46811, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-636476314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4993244343269496237_1088, duration: 404687
2013-10-31 18:32:13,289 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0009: nMaps=4 nReduces=0 max=-1
2013-10-31 18:32:13,290 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0009 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:32:13,290 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0009
2013-10-31 18:32:13,290 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0009	RESULT=SUCCESS
2013-10-31 18:32:13,290 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0009
2013-10-31 18:32:13,291 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0009
2013-10-31 18:32:13,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3808353552338567285_1088 src: /127.0.0.1:42921 dest: /127.0.0.1:59471
2013-10-31 18:32:13,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,302 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3808353552338567285_1088 src: /127.0.0.1:46813 dest: /127.0.0.1:37740
2013-10-31 18:32:13,304 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3808353552338567285_1088 src: /127.0.0.1:47097 dest: /127.0.0.1:54365
2013-10-31 18:32:13,309 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47097, dest: /127.0.0.1:54365, bytes: 27813, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3808353552338567285_1088, duration: 1951689
2013-10-31 18:32:13,309 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3808353552338567285_1088 terminating
2013-10-31 18:32:13,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46813, dest: /127.0.0.1:37740, bytes: 27813, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3808353552338567285_1088, duration: 3440430
2013-10-31 18:32:13,311 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3808353552338567285_1088 terminating
2013-10-31 18:32:13,312 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3808353552338567285_1088 size 27813
2013-10-31 18:32:13,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42921, dest: /127.0.0.1:59471, bytes: 27813, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 5644292
2013-10-31 18:32:13,313 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3808353552338567285_1088 size 27813
2013-10-31 18:32:13,313 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3808353552338567285_1088 terminating
2013-10-31 18:32:13,316 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml from client DFSClient_-1596270109
2013-10-31 18:32:13,316 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:32:13,318 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3808353552338567285_1088 size 27813
2013-10-31 18:32:13,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=null
2013-10-31 18:32:13,332 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml. blk_1249157363671041976_1090
2013-10-31 18:32:13,333 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42925, bytes: 28033, op: HDFS_READ, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 401445
2013-10-31 18:32:13,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1249157363671041976_1090 src: /127.0.0.1:47100 dest: /127.0.0.1:54365
2013-10-31 18:32:13,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1249157363671041976_1090 src: /127.0.0.1:49730 dest: /127.0.0.1:34578
2013-10-31 18:32:13,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1249157363671041976_1090 src: /127.0.0.1:46819 dest: /127.0.0.1:37740
2013-10-31 18:32:13,343 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46819, dest: /127.0.0.1:37740, bytes: 27882, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1249157363671041976_1090, duration: 2287511
2013-10-31 18:32:13,344 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1249157363671041976_1090 terminating
2013-10-31 18:32:13,345 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1249157363671041976_1090 size 27882
2013-10-31 18:32:13,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49730, dest: /127.0.0.1:34578, bytes: 27882, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1249157363671041976_1090, duration: 4261506
2013-10-31 18:32:13,345 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1249157363671041976_1090 terminating
2013-10-31 18:32:13,347 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47100, dest: /127.0.0.1:54365, bytes: 27882, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1249157363671041976_1090, duration: 5969162
2013-10-31 18:32:13,347 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1249157363671041976_1090 terminating
2013-10-31 18:32:13,349 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1249157363671041976_1090 size 27882
2013-10-31 18:32:13,349 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml from client DFSClient_-636476314
2013-10-31 18:32:13,350 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml is closed by DFSClient_-636476314
2013-10-31 18:32:13,351 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1249157363671041976_1090 size 27882
2013-10-31 18:32:13,358 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0010: nMaps=4 nReduces=0 max=-1
2013-10-31 18:32:13,358 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0010 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:32:13,359 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0010
2013-10-31 18:32:13,359 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0010	RESULT=SUCCESS
2013-10-31 18:32:13,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,359 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0010
2013-10-31 18:32:13,361 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken. blk_-6152330823190221756_1091
2013-10-31 18:32:13,364 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6152330823190221756_1091 src: /127.0.0.1:47104 dest: /127.0.0.1:54365
2013-10-31 18:32:13,365 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6152330823190221756_1091 src: /127.0.0.1:42931 dest: /127.0.0.1:59471
2013-10-31 18:32:13,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6152330823190221756_1091 src: /127.0.0.1:49735 dest: /127.0.0.1:34578
2013-10-31 18:32:13,371 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0010
2013-10-31 18:32:13,371 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49735, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6152330823190221756_1091, duration: 982825
2013-10-31 18:32:13,372 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6152330823190221756_1091 terminating
2013-10-31 18:32:13,373 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42931, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6152330823190221756_1091, duration: 2958678
2013-10-31 18:32:13,373 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6152330823190221756_1091 terminating
2013-10-31 18:32:13,373 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6152330823190221756_1091 size 116
2013-10-31 18:32:13,375 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6152330823190221756_1091 size 116
2013-10-31 18:32:13,375 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47104, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6152330823190221756_1091, duration: 4992183
2013-10-31 18:32:13,376 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6152330823190221756_1091 terminating
2013-10-31 18:32:13,377 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken from client DFSClient_-1596270109
2013-10-31 18:32:13,378 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:32:13,380 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6152330823190221756_1091 size 116
2013-10-31 18:32:13,392 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-4134747532649829860_1082 to datanode(s) 127.0.0.1:54365
2013-10-31 18:32:13,393 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_1765133373633960270_1082 to datanode(s) 127.0.0.1:59471
2013-10-31 18:32:13,394 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_3249008124411573785_1075
2013-10-31 18:32:13,394 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_3249008124411573785_1075
2013-10-31 18:32:13,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,615 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken
2013-10-31 18:32:13,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:32:13,620 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47107, bytes: 157, op: HDFS_READ, cliID: DFSClient_-636476314, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4081485762383124586_1085, duration: 285911
2013-10-31 18:32:13,621 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0009 = 804. Number of splits = 4
2013-10-31 18:32:13,621 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,621 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,621 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,624 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,624 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0009 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:32:13,624 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0009 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:32:13,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,637 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml. blk_-2757987895680919733_1093
2013-10-31 18:32:13,639 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2757987895680919733_1093 src: /127.0.0.1:42934 dest: /127.0.0.1:59471
2013-10-31 18:32:13,640 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2757987895680919733_1093 src: /127.0.0.1:47109 dest: /127.0.0.1:54365
2013-10-31 18:32:13,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2757987895680919733_1093 src: /127.0.0.1:49739 dest: /127.0.0.1:34578
2013-10-31 18:32:13,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49739, dest: /127.0.0.1:34578, bytes: 27878, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2757987895680919733_1093, duration: 3924459
2013-10-31 18:32:13,650 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2757987895680919733_1093 terminating
2013-10-31 18:32:13,651 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47109, dest: /127.0.0.1:54365, bytes: 27878, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2757987895680919733_1093, duration: 5486889
2013-10-31 18:32:13,652 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2757987895680919733_1093 terminating
2013-10-31 18:32:13,653 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42934, dest: /127.0.0.1:59471, bytes: 27878, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2757987895680919733_1093, duration: 7046751
2013-10-31 18:32:13,653 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2757987895680919733_1093 size 27878
2013-10-31 18:32:13,653 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2757987895680919733_1093 terminating
2013-10-31 18:32:13,655 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2757987895680919733_1093 size 27878
2013-10-31 18:32:13,655 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml from client DFSClient_-1859484039
2013-10-31 18:32:13,656 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml is closed by DFSClient_-1859484039
2013-10-31 18:32:13,656 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2757987895680919733_1093 size 27878
2013-10-31 18:32:13,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,671 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken. blk_726165482891072064_1094
2013-10-31 18:32:13,673 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_726165482891072064_1094 src: /127.0.0.1:46828 dest: /127.0.0.1:37740
2013-10-31 18:32:13,674 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_726165482891072064_1094 src: /127.0.0.1:42938 dest: /127.0.0.1:59471
2013-10-31 18:32:13,676 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_726165482891072064_1094 src: /127.0.0.1:49742 dest: /127.0.0.1:34578
2013-10-31 18:32:13,679 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49742, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_726165482891072064_1094, duration: 821250
2013-10-31 18:32:13,680 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_726165482891072064_1094 terminating
2013-10-31 18:32:13,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42938, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 3543607
2013-10-31 18:32:13,683 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_726165482891072064_1094 size 116
2013-10-31 18:32:13,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_726165482891072064_1094 terminating
2013-10-31 18:32:13,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46828, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_726165482891072064_1094, duration: 4654132
2013-10-31 18:32:13,684 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_726165482891072064_1094 size 116
2013-10-31 18:32:13,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_726165482891072064_1094 terminating
2013-10-31 18:32:13,687 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_726165482891072064_1094 size 116
2013-10-31 18:32:13,688 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken from client DFSClient_-1596270109
2013-10-31 18:32:13,688 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:32:13,693 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken
2013-10-31 18:32:13,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:32:13,698 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42940, bytes: 157, op: HDFS_READ, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6246259349516176919_1087, duration: 283860
2013-10-31 18:32:13,699 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0010 = 804. Number of splits = 4
2013-10-31 18:32:13,699 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,699 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,702 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0010 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:32:13,702 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0010 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:32:14,176 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0009_m_000005_0' to tip task_20131031182606197_0009_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:14,180 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000000_0'
2013-10-31 18:32:14,180 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000005_0'
2013-10-31 18:32:14,182 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:32:14,182 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,182 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken	dst=null	perm=null
2013-10-31 18:32:14,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49744, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6152330823190221756_1091, duration: 304159
2013-10-31 18:32:14,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml	dst=null	perm=null
2013-10-31 18:32:14,205 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49746, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-1486956122, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4993244343269496237_1088, duration: 396477
2013-10-31 18:32:14,236 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:14,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar	dst=null	perm=null
2013-10-31 18:32:14,269 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47118, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1486956122, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1765133373633960270_1082, duration: 1412338
2013-10-31 18:32:14,290 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0010_m_000005_0' to tip task_20131031182606197_0010_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:14,296 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000001_0'
2013-10-31 18:32:14,298 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:32:14,298 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,298 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0010_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken	dst=null	perm=null
2013-10-31 18:32:14,307 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42945, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 384423
2013-10-31 18:32:14,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=null
2013-10-31 18:32:14,317 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47121, bytes: 28033, op: HDFS_READ, cliID: DFSClient_-478108362, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3808353552338567285_1088, duration: 393343
2013-10-31 18:32:14,320 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000002_0'
2013-10-31 18:32:14,330 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:14,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=null
2013-10-31 18:32:14,347 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46839, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-478108362, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4134747532649829860_1082, duration: 683580
2013-10-31 18:32:14,420 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0008_m_966824357
2013-10-31 18:32:14,429 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21103 with signal TERM. Exit code 0
2013-10-31 18:32:14,430 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_1297381535
2013-10-31 18:32:14,431 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_1297381535 spawned.
2013-10-31 18:32:14,433 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000005_0/taskjvm.sh
2013-10-31 18:32:14,499 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_476228411
2013-10-31 18:32:14,500 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_476228411 spawned.
2013-10-31 18:32:14,501 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000005_0/taskjvm.sh
2013-10-31 18:32:14,578 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0008_m_966824357
2013-10-31 18:32:14,753 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3249008124411573785_1075 file build/test/data/dfs/data/data5/current/blk_3249008124411573785 for deletion
2013-10-31 18:32:14,753 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3249008124411573785_1075 at file build/test/data/dfs/data/data5/current/blk_3249008124411573785
2013-10-31 18:32:15,010 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:15,010 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:15,010 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:15,011 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_966824357 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:15,222 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-4134747532649829860_1082 to 127.0.0.1:54365 
2013-10-31 18:32:15,222 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_1765133373633960270_1082 to 127.0.0.1:59471 
2013-10-31 18:32:15,223 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3249008124411573785_1075 file build/test/data/dfs/data/data8/current/blk_3249008124411573785 for deletion
2013-10-31 18:32:15,223 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3249008124411573785_1075 at file build/test/data/dfs/data/data8/current/blk_3249008124411573785
2013-10-31 18:32:15,223 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-4134747532649829860_1082 to /127.0.0.1:54365
2013-10-31 18:32:15,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:42949 dest: /127.0.0.1:59471
2013-10-31 18:32:15,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:47123 dest: /127.0.0.1:54365
2013-10-31 18:32:15,223 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_1765133373633960270_1082 to /127.0.0.1:59471
2013-10-31 18:32:15,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1765133373633960270_1082 src: /127.0.0.1:42949 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:32:15,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4134747532649829860_1082 src: /127.0.0.1:47123 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:32:15,226 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:15,228 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:15,695 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_1297381535 given task: attempt_20131031182606197_0009_m_000005_0
2013-10-31 18:32:15,753 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_476228411 given task: attempt_20131031182606197_0010_m_000005_0
2013-10-31 18:32:16,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:16,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:16,363 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:16,364 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000004_0 not found in cache
2013-10-31 18:32:16,364 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000003_0 not found in cache
2013-10-31 18:32:16,365 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330736364
2013-10-31 18:32:16,395 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_3249008124411573785_1075
2013-10-31 18:32:16,601 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_775790396 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:16,612 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21633 with signal TERM. Exit code 0
2013-10-31 18:32:16,739 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_1577226638 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:16,744 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21485 with signal TERM. Exit code 0
2013-10-31 18:32:16,775 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:16,775 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:16,775 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:16,775 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_775790396 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:16,919 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:16,920 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:16,920 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:16,920 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_1577226638 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:18,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3249008124411573785_1075 file build/test/data/dfs/data/data1/current/blk_3249008124411573785 for deletion
2013-10-31 18:32:18,151 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3249008124411573785_1075 at file build/test/data/dfs/data/data1/current/blk_3249008124411573785
2013-10-31 18:32:19,115 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000005_0 0.0% setup
2013-10-31 18:32:19,118 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000005_0 is done.
2013-10-31 18:32:19,118 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000005_0  was -1
2013-10-31 18:32:19,118 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:19,177 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000005_0 0.0% setup
2013-10-31 18:32:19,180 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000005_0 is done.
2013-10-31 18:32:19,180 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000005_0  was -1
2013-10-31 18:32:19,180 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:19,182 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:19,183 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000000_0 not found in cache
2013-10-31 18:32:19,184 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330739183
2013-10-31 18:32:19,298 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:19,299 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000001_0 not found in cache
2013-10-31 18:32:19,299 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330739299
2013-10-31 18:32:19,321 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:19,321 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000002_0 not found in cache
2013-10-31 18:32:19,322 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330739321
2013-10-31 18:32:19,815 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_-753643868 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:19,820 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_1411612696 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:19,827 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21326 with signal TERM. Exit code 0
2013-10-31 18:32:19,831 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21484 with signal TERM. Exit code 0
2013-10-31 18:32:20,001 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,001 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,001 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,001 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,001 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:20,001 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:20,001 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_1411612696 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:20,001 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_-753643868 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:20,188 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000005_0' has completed task_20131031182606197_0009_m_000005 successfully.
2013-10-31 18:32:20,192 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000000_0' to tip task_20131031182606197_0009_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:20,193 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000000
2013-10-31 18:32:20,195 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:32:20,195 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,195 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,226 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_759702916
2013-10-31 18:32:20,226 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_759702916 spawned.
2013-10-31 18:32:20,228 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000000_0/taskjvm.sh
2013-10-31 18:32:20,305 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000005_0' has completed task_20131031182606197_0010_m_000005 successfully.
2013-10-31 18:32:20,311 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000001_0' to tip task_20131031182606197_0009_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:20,311 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000001
2013-10-31 18:32:20,312 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000002_0' to tip task_20131031182606197_0009_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:20,313 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000002
2013-10-31 18:32:20,315 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:32:20,316 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:32:20,316 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,316 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,317 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,317 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0009_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,326 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000003_0' to tip task_20131031182606197_0009_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:20,327 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000003
2013-10-31 18:32:20,329 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000000_0' to tip task_20131031182606197_0010_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:20,331 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000000
2013-10-31 18:32:20,333 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:32:20,334 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:32:20,334 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000003_0 which needs 1 slots
2013-10-31 18:32:20,334 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000003_0 which needs 1 slots
2013-10-31 18:32:20,335 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,335 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0010_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,372 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000001_0' to tip task_20131031182606197_0010_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:20,372 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000001
2013-10-31 18:32:20,373 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000002_0' to tip task_20131031182606197_0010_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:20,373 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000002
2013-10-31 18:32:20,375 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:32:20,376 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:32:20,376 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,376 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0010_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,377 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,377 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0010_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken	dst=null	perm=null
2013-10-31 18:32:20,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken	dst=null	perm=null
2013-10-31 18:32:20,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken	dst=null	perm=null
2013-10-31 18:32:20,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken	dst=null	perm=null
2013-10-31 18:32:20,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42957, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 149669
2013-10-31 18:32:20,475 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47129, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6152330823190221756_1091, duration: 384572
2013-10-31 18:32:20,475 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46847, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_726165482891072064_1094, duration: 383232
2013-10-31 18:32:20,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=null
2013-10-31 18:32:20,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml	dst=null	perm=null
2013-10-31 18:32:20,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=null
2013-10-31 18:32:20,488 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42961, bytes: 28033, op: HDFS_READ, cliID: DFSClient_1284330603, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 412382
2013-10-31 18:32:20,488 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47136, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-575752910, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4993244343269496237_1088, duration: 421524
2013-10-31 18:32:20,490 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42963, bytes: 28033, op: HDFS_READ, cliID: DFSClient_708408331, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 1203168
2013-10-31 18:32:20,514 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49767, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6152330823190221756_1091, duration: 293915
2013-10-31 18:32:20,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml	dst=null	perm=null
2013-10-31 18:32:20,525 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,525 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,525 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46857, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-754400775, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4993244343269496237_1088, duration: 411235
2013-10-31 18:32:20,549 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=null
2013-10-31 18:32:20,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=null
2013-10-31 18:32:20,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar	dst=null	perm=null
2013-10-31 18:32:20,552 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42967, bytes: 239915, op: HDFS_READ, cliID: DFSClient_708408331, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4134747532649829860_1082, duration: 683915
2013-10-31 18:32:20,552 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42969, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-575752910, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1765133373633960270_1082, duration: 724074
2013-10-31 18:32:20,552 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46859, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1284330603, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4134747532649829860_1082, duration: 812257
2013-10-31 18:32:20,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar	dst=null	perm=null
2013-10-31 18:32:20,563 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47144, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-754400775, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1765133373633960270_1082, duration: 670477
2013-10-31 18:32:20,633 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_1371704024
2013-10-31 18:32:20,633 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_-1788039440
2013-10-31 18:32:20,634 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_1371704024 spawned.
2013-10-31 18:32:20,635 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_-1788039440 spawned.
2013-10-31 18:32:20,635 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_-1154774997
2013-10-31 18:32:20,635 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_1071625860
2013-10-31 18:32:20,636 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_-1154774997 spawned.
2013-10-31 18:32:20,637 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_1071625860 spawned.
2013-10-31 18:32:20,637 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0010_m_476228411
2013-10-31 18:32:20,639 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000002_0/taskjvm.sh
2013-10-31 18:32:20,639 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000000_0/taskjvm.sh
2013-10-31 18:32:20,640 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000001_0/taskjvm.sh
2013-10-31 18:32:20,640 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000001_0/taskjvm.sh
2013-10-31 18:32:20,643 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21887 with signal TERM. Exit code 0
2013-10-31 18:32:20,643 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_-760035825
2013-10-31 18:32:20,644 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_-760035825 spawned.
2013-10-31 18:32:20,644 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0008_m_-1990778351
2013-10-31 18:32:20,645 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000002_0/taskjvm.sh
2013-10-31 18:32:20,648 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21416 with signal TERM. Exit code 0
2013-10-31 18:32:20,648 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_1345701271
2013-10-31 18:32:20,650 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_1345701271 spawned.
2013-10-31 18:32:20,652 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000003_0/taskjvm.sh
2013-10-31 18:32:20,668 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0008_m_-1990778351
2013-10-31 18:32:20,725 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,725 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,725 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:20,726 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_476228411 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:20,810 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,810 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,810 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:20,811 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_-1990778351 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:21,306 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_759702916 given task: attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:21,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=null
2013-10-31 18:32:21,864 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47147, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7445994968599272333_1083, duration: 170437
2013-10-31 18:32:21,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000	dst=null	perm=null
2013-10-31 18:32:21,904 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46865, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7738361136727118235_1077, duration: 261530
2013-10-31 18:32:23,198 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000003_0' to tip task_20131031182606197_0010_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:23,199 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000003
2013-10-31 18:32:23,202 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:32:23,203 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000003_0 which needs 1 slots
2013-10-31 18:32:23,203 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0010_m_000003_0 which needs 1 slots
2013-10-31 18:32:23,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken	dst=null	perm=null
2013-10-31 18:32:23,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42975, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 307390
2013-10-31 18:32:23,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml	dst=null	perm=null
2013-10-31 18:32:23,224 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42977, bytes: 28033, op: HDFS_READ, cliID: DFSClient_1355569340, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 408509
2013-10-31 18:32:23,250 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:23,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar	dst=null	perm=null
2013-10-31 18:32:23,285 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42978, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1355569340, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4134747532649829860_1082, duration: 1608698
2013-10-31 18:32:25,195 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0009_m_000005_0
2013-10-31 18:32:25,196 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0009_m_000005_0
2013-10-31 18:32:25,196 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000005_0 not found in cache
2013-10-31 18:32:25,316 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0010_m_000005_0
2013-10-31 18:32:25,317 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0010_m_000005_0
2013-10-31 18:32:25,317 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000005_0 not found in cache
2013-10-31 18:32:27,345 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0009_m_1297381535
2013-10-31 18:32:27,352 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21857 with signal TERM. Exit code 0
2013-10-31 18:32:27,353 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:27,354 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_-775097629 spawned.
2013-10-31 18:32:27,355 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000003_0/taskjvm.sh
2013-10-31 18:32:27,435 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:27,435 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:27,435 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:27,436 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_1297381535 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:27,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:27,574 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 492 Total time for transactions(ms): 11Number of transactions batched in Syncs: 21 Number of syncs: 339 SyncTimes(ms): 49177 10498 
2013-10-31 18:32:27,800 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:27,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:28,016 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000. blk_-5467518339498007322_1095
2013-10-31 18:32:28,053 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5467518339498007322_1095 src: /127.0.0.1:47154 dest: /127.0.0.1:54365
2013-10-31 18:32:28,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5467518339498007322_1095 src: /127.0.0.1:42981 dest: /127.0.0.1:59471
2013-10-31 18:32:28,055 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5467518339498007322_1095 src: /127.0.0.1:46873 dest: /127.0.0.1:37740
2013-10-31 18:32:28,058 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46873, dest: /127.0.0.1:37740, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5467518339498007322_1095, duration: 1882527
2013-10-31 18:32:28,058 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5467518339498007322_1095 terminating
2013-10-31 18:32:28,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42981, dest: /127.0.0.1:59471, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5467518339498007322_1095, duration: 2485109
2013-10-31 18:32:28,059 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5467518339498007322_1095 terminating
2013-10-31 18:32:28,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47154, dest: /127.0.0.1:54365, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5467518339498007322_1095, duration: 3131289
2013-10-31 18:32:28,060 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5467518339498007322_1095 size 176
2013-10-31 18:32:28,060 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5467518339498007322_1095 terminating
2013-10-31 18:32:28,061 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5467518339498007322_1095 size 176
2013-10-31 18:32:28,061 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5467518339498007322_1095 size 176
2013-10-31 18:32:28,063 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:28,063 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:28,109 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:28,109 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:28,380 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_1371704024 given task: attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:28,740 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_-1788039440 given task: attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:28,754 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_-760035825 given task: attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:28,782 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_1071625860 given task: attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:28,785 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_-775097629 given task: attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:28,788 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_-1154774997 given task: attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:28,789 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_1345701271 given task: attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:28,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=null
2013-10-31 18:32:28,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47165, bytes: 883, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8036407782984700833_1085, duration: 269632
2013-10-31 18:32:28,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001	dst=null	perm=null
2013-10-31 18:32:28,981 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49795, bytes: 218, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-257311796089327943_1079, duration: 162711
2013-10-31 18:32:29,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:29,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:29,200 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002. blk_3055933182081159268_1096
2013-10-31 18:32:29,207 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:29,224 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3055933182081159268_1096 src: /127.0.0.1:42994 dest: /127.0.0.1:59471
2013-10-31 18:32:29,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3055933182081159268_1096 src: /127.0.0.1:49799 dest: /127.0.0.1:34578
2013-10-31 18:32:29,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3055933182081159268_1096 src: /127.0.0.1:47171 dest: /127.0.0.1:54365
2013-10-31 18:32:29,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47171, dest: /127.0.0.1:54365, bytes: 130, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3055933182081159268_1096, duration: 1266398
2013-10-31 18:32:29,228 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3055933182081159268_1096 terminating
2013-10-31 18:32:29,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49799, dest: /127.0.0.1:34578, bytes: 130, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3055933182081159268_1096, duration: 1737902
2013-10-31 18:32:29,229 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3055933182081159268_1096 terminating
2013-10-31 18:32:29,229 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42994, dest: /127.0.0.1:59471, bytes: 130, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3055933182081159268_1096, duration: 2136246
2013-10-31 18:32:29,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3055933182081159268_1096 size 130
2013-10-31 18:32:29,229 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3055933182081159268_1096 terminating
2013-10-31 18:32:29,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3055933182081159268_1096 size 130
2013-10-31 18:32:29,230 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:29,230 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:29,231 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3055933182081159268_1096 size 130
2013-10-31 18:32:29,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=null
2013-10-31 18:32:29,284 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49804, bytes: 883, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7445994968599272333_1083, duration: 179350
2013-10-31 18:32:29,292 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:29,292 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000002_0 0.0% 
2013-10-31 18:32:29,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=null
2013-10-31 18:32:29,307 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46894, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036407782984700833_1085, duration: 177282
2013-10-31 18:32:29,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=null
2013-10-31 18:32:29,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001	dst=null	perm=null
2013-10-31 18:32:29,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split	dst=null	perm=null
2013-10-31 18:32:29,322 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47178, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8036407782984700833_1085, duration: 180220
2013-10-31 18:32:29,322 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49808, bytes: 218, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-257311796089327943_1079, duration: 125668
2013-10-31 18:32:29,325 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46897, bytes: 367, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036407782984700833_1085, duration: 110732
2013-10-31 18:32:29,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000	dst=null	perm=null
2013-10-31 18:32:29,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=null
2013-10-31 18:32:29,346 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49810, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7738361136727118235_1077, duration: 132877
2013-10-31 18:32:29,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:29,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43008, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7445994968599272333_1083, duration: 142216
2013-10-31 18:32:29,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:29,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003	dst=null	perm=null
2013-10-31 18:32:29,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002	dst=null	perm=null
2013-10-31 18:32:29,360 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43009, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4349690085078030343_1079, duration: 141281
2013-10-31 18:32:29,362 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49813, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7731653809023951984_1077, duration: 109520
2013-10-31 18:32:29,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split	dst=null	perm=null
2013-10-31 18:32:29,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003	dst=null	perm=null
2013-10-31 18:32:29,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46902, bytes: 367, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7445994968599272333_1083, duration: 130107
2013-10-31 18:32:29,384 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:29,387 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43012, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4349690085078030343_1079, duration: 133121
2013-10-31 18:32:29,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002	dst=null	perm=null
2013-10-31 18:32:29,420 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49816, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7731653809023951984_1077, duration: 107177
2013-10-31 18:32:30,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0	dst=null	perm=null
2013-10-31 18:32:30,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0	dst=null	perm=null
2013-10-31 18:32:30,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:30,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,023 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:31,024 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:31,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0	dst=null	perm=null
2013-10-31 18:32:31,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0	dst=null	perm=null
2013-10-31 18:32:31,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,250 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,250 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000002_0 0.0% 
2013-10-31 18:32:31,381 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:31,381 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:31,396 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:31,397 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:31,402 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:31,402 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:31,403 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001. blk_8597259860310358460_1102
2013-10-31 18:32:31,407 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:31,407 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:31,428 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,429 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000003_0 0.0% 
2013-10-31 18:32:31,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8597259860310358460_1102 src: /127.0.0.1:46905 dest: /127.0.0.1:37740
2013-10-31 18:32:31,458 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8597259860310358460_1102 src: /127.0.0.1:43015 dest: /127.0.0.1:59471
2013-10-31 18:32:31,459 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8597259860310358460_1102 src: /127.0.0.1:47190 dest: /127.0.0.1:54365
2013-10-31 18:32:31,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47190, dest: /127.0.0.1:54365, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8597259860310358460_1102, duration: 1501713
2013-10-31 18:32:31,461 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8597259860310358460_1102 terminating
2013-10-31 18:32:31,462 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8597259860310358460_1102 size 176
2013-10-31 18:32:31,462 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43015, dest: /127.0.0.1:59471, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8597259860310358460_1102, duration: 1712999
2013-10-31 18:32:31,462 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8597259860310358460_1102 terminating
2013-10-31 18:32:31,462 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46905, dest: /127.0.0.1:37740, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8597259860310358460_1102, duration: 2088924
2013-10-31 18:32:31,463 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8597259860310358460_1102 terminating
2013-10-31 18:32:31,463 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:31,464 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:31,465 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8597259860310358460_1102 size 176
2013-10-31 18:32:31,465 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8597259860310358460_1102 size 176
2013-10-31 18:32:31,527 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,527 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000000_0 0.0% 
2013-10-31 18:32:31,528 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,529 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,529 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000001_0 0.0% 
2013-10-31 18:32:31,529 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000001_0 0.0% 
2013-10-31 18:32:31,531 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,531 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000003_0 0.0% 
2013-10-31 18:32:31,858 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001:0+214
2013-10-31 18:32:31,860 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000002_0 is done.
2013-10-31 18:32:31,860 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000002_0  was -1
2013-10-31 18:32:31,860 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:32,212 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:32,327 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:32,327 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:32,344 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:32,345 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:32,387 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000002_0' has completed task_20131031182606197_0010_m_000002 successfully.
2013-10-31 18:32:32,390 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:32,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0	dst=null	perm=null
2013-10-31 18:32:32,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0	dst=null	perm=null
2013-10-31 18:32:32,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0	dst=null	perm=null
2013-10-31 18:32:32,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0	dst=null	perm=null
2013-10-31 18:32:32,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0	dst=null	perm=null
2013-10-31 18:32:32,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0	dst=null	perm=null
2013-10-31 18:32:32,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0	dst=null	perm=null
2013-10-31 18:32:32,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0	dst=null	perm=null
2013-10-31 18:32:32,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0	dst=null	perm=null
2013-10-31 18:32:32,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0	dst=null	perm=null
2013-10-31 18:32:33,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0	dst=null	perm=null
2013-10-31 18:32:33,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:33,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:33,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0	dst=null	perm=null
2013-10-31 18:32:33,835 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:33,837 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:33,838 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000000_0 is done.
2013-10-31 18:32:33,838 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000000_0  was -1
2013-10-31 18:32:33,838 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:35,216 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000000_0' has completed task_20131031182606197_0009_m_000000 successfully.
2013-10-31 18:32:35,241 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001:0+214
2013-10-31 18:32:35,243 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001:0+214
2013-10-31 18:32:35,243 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000002_0 is done.
2013-10-31 18:32:35,243 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000002_0  was -1
2013-10-31 18:32:35,243 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:35,262 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:35,266 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:35,267 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000000_0 is done.
2013-10-31 18:32:35,267 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000000_0  was -1
2013-10-31 18:32:35,268 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:35,289 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,291 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,292 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,292 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000001_0 is done.
2013-10-31 18:32:35,292 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000001_0  was -1
2013-10-31 18:32:35,292 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,295 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,296 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000003_0 is done.
2013-10-31 18:32:35,296 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000003_0  was -1
2013-10-31 18:32:35,297 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,306 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,308 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,309 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000001_0 is done.
2013-10-31 18:32:35,309 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000001_0  was -1
2013-10-31 18:32:35,309 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,331 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000001_0' has completed task_20131031182606197_0009_m_000001 successfully.
2013-10-31 18:32:35,332 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000002_0' has completed task_20131031182606197_0009_m_000002 successfully.
2013-10-31 18:32:35,343 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,345 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,346 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000003_0 is done.
2013-10-31 18:32:35,346 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000003_0  was -1
2013-10-31 18:32:35,346 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,348 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000000_0' has completed task_20131031182606197_0010_m_000000 successfully.
2013-10-31 18:32:35,351 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:35,394 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000001_0' has completed task_20131031182606197_0010_m_000001 successfully.
2013-10-31 18:32:38,223 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000003_0' has completed task_20131031182606197_0010_m_000003 successfully.
2013-10-31 18:32:38,227 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0010_m_000004_0' to tip task_20131031182606197_0010_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:38,231 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:32:38,231 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,232 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0010_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,266 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0010/attempt_20131031182606197_0010_m_000004_0. Attempting to reuse: jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:38,353 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000003_0' has completed task_20131031182606197_0009_m_000003 successfully.
2013-10-31 18:32:38,357 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0009_m_000004_0' to tip task_20131031182606197_0009_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:38,359 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:32:38,360 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,360 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,388 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0009/attempt_20131031182606197_0009_m_000004_0. Attempting to reuse: jvm_20131031182606197_0009_m_1345701271
2013-10-31 18:32:38,833 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_-775097629 given task: attempt_20131031182606197_0010_m_000004_0
2013-10-31 18:32:38,881 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_1345701271 given task: attempt_20131031182606197_0009_m_000004_0
2013-10-31 18:32:38,975 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000004_0 0.0% 
2013-10-31 18:32:38,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary	dst=null	perm=null
2013-10-31 18:32:38,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:38,988 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_SUCCESS from client DFSClient_attempt_20131031182606197_0010_m_000004_0
2013-10-31 18:32:38,989 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0010_m_000004_0
2013-10-31 18:32:38,992 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6246259349516176919 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6246259349516176919 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6246259349516176919 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,993 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3808353552338567285 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,994 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3808353552338567285 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:38,994 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3808353552338567285 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010	dst=null	perm=null
2013-10-31 18:32:39,015 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000004_0 0.0% 
2013-10-31 18:32:39,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary	dst=null	perm=null
2013-10-31 18:32:39,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:39,030 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_SUCCESS from client DFSClient_attempt_20131031182606197_0009_m_000004_0
2013-10-31 18:32:39,030 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0009_m_000004_0
2013-10-31 18:32:39,036 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,036 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,036 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:39,036 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:39,036 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,036 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4081485762383124586 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4081485762383124586 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4081485762383124586 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4993244343269496237 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4993244343269496237 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,037 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4993244343269496237 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009	dst=null	perm=null
2013-10-31 18:32:40,400 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-4134747532649829860_1082 blk_-6246259349516176919_1087 blk_-8036407782984700833_1085 blk_-4081485762383124586_1085 blk_7445994968599272333_1083 blk_3808353552338567285_1088 blk_1765133373633960270_1082
2013-10-31 18:32:40,400 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-4134747532649829860_1082 blk_-6246259349516176919_1087 blk_-8036407782984700833_1085 blk_-4081485762383124586_1085 blk_7445994968599272333_1083 blk_-4993244343269496237_1088 blk_3808353552338567285_1088 blk_1765133373633960270_1082
2013-10-31 18:32:41,762 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data6/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:41,762 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6246259349516176919_1087 file build/test/data/dfs/data/data6/current/blk_-6246259349516176919 for deletion
2013-10-31 18:32:41,762 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data6/current/blk_-8036407782984700833
2013-10-31 18:32:41,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data6/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:41,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6246259349516176919_1087 at file build/test/data/dfs/data/data6/current/blk_-6246259349516176919
2013-10-31 18:32:41,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4081485762383124586_1085 file build/test/data/dfs/data/data5/current/blk_-4081485762383124586 for deletion
2013-10-31 18:32:41,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data6/current/blk_-4134747532649829860
2013-10-31 18:32:41,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4081485762383124586_1085 at file build/test/data/dfs/data/data5/current/blk_-4081485762383124586
2013-10-31 18:32:41,763 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data5/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:41,764 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3808353552338567285_1088 file build/test/data/dfs/data/data5/current/blk_3808353552338567285 for deletion
2013-10-31 18:32:41,764 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data5/current/blk_1765133373633960270
2013-10-31 18:32:41,764 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data5/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:41,765 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3808353552338567285_1088 at file build/test/data/dfs/data/data5/current/blk_3808353552338567285
2013-10-31 18:32:41,765 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data5/current/blk_7445994968599272333
2013-10-31 18:32:41,919 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000004_0 0.0% cleanup
2013-10-31 18:32:41,921 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000004_0 is done.
2013-10-31 18:32:41,921 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000004_0  was -1
2013-10-31 18:32:41,921 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:41,965 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000004_0 0.0% cleanup
2013-10-31 18:32:41,966 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000004_0 is done.
2013-10-31 18:32:41,967 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000004_0  was -1
2013-10-31 18:32:41,967 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:42,232 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data7/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:42,232 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6246259349516176919_1087 file build/test/data/dfs/data/data7/current/blk_-6246259349516176919 for deletion
2013-10-31 18:32:42,232 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data7/current/blk_-8036407782984700833
2013-10-31 18:32:42,232 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4993244343269496237_1088 file build/test/data/dfs/data/data8/current/blk_-4993244343269496237 for deletion
2013-10-31 18:32:42,233 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6246259349516176919_1087 at file build/test/data/dfs/data/data7/current/blk_-6246259349516176919
2013-10-31 18:32:42,233 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data7/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:42,233 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4993244343269496237_1088 at file build/test/data/dfs/data/data8/current/blk_-4993244343269496237
2013-10-31 18:32:42,233 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4081485762383124586_1085 file build/test/data/dfs/data/data8/current/blk_-4081485762383124586 for deletion
2013-10-31 18:32:42,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data7/current/blk_-4134747532649829860
2013-10-31 18:32:42,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data8/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:42,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4081485762383124586_1085 at file build/test/data/dfs/data/data8/current/blk_-4081485762383124586
2013-10-31 18:32:42,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3808353552338567285_1088 file build/test/data/dfs/data/data7/current/blk_3808353552338567285 for deletion
2013-10-31 18:32:42,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data8/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:42,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3808353552338567285_1088 at file build/test/data/dfs/data/data7/current/blk_3808353552338567285
2013-10-31 18:32:42,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data8/current/blk_1765133373633960270
2013-10-31 18:32:42,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data8/current/blk_7445994968599272333
2013-10-31 18:32:43,401 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-4134747532649829860_1082 blk_-6246259349516176919_1087 blk_-8036407782984700833_1085 blk_7445994968599272333_1083 blk_-4993244343269496237_1088 blk_1765133373633960270_1082
2013-10-31 18:32:43,401 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-4134747532649829860_1082 blk_-8036407782984700833_1085 blk_-4081485762383124586_1085 blk_7445994968599272333_1083 blk_-4993244343269496237_1088 blk_3808353552338567285_1088 blk_1765133373633960270_1082
2013-10-31 18:32:44,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data4/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:44,034 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4993244343269496237_1088 file build/test/data/dfs/data/data4/current/blk_-4993244343269496237 for deletion
2013-10-31 18:32:44,035 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data3/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:44,035 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4081485762383124586_1085 file build/test/data/dfs/data/data3/current/blk_-4081485762383124586 for deletion
2013-10-31 18:32:44,035 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data4/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:44,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3808353552338567285_1088 file build/test/data/dfs/data/data3/current/blk_3808353552338567285 for deletion
2013-10-31 18:32:44,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data3/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:44,237 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000004_0' has completed task_20131031182606197_0010_m_000004 successfully.
2013-10-31 18:32:45,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data1/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:45,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6246259349516176919_1087 file build/test/data/dfs/data/data2/current/blk_-6246259349516176919 for deletion
2013-10-31 18:32:45,160 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4993244343269496237_1088 file build/test/data/dfs/data/data1/current/blk_-4993244343269496237 for deletion
2013-10-31 18:32:45,161 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data1/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:45,161 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data2/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:45,161 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data2/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:45,645 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data4/current/blk_-8036407782984700833
2013-10-31 18:32:45,645 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6246259349516176919_1087 at file build/test/data/dfs/data/data2/current/blk_-6246259349516176919
2013-10-31 18:32:45,646 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4993244343269496237_1088 at file build/test/data/dfs/data/data4/current/blk_-4993244343269496237
2013-10-31 18:32:45,646 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0010 has completed successfully.
2013-10-31 18:32:45,645 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data1/current/blk_-8036407782984700833
2013-10-31 18:32:45,646 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data2/current/blk_1765133373633960270
2013-10-31 18:32:45,647 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4993244343269496237_1088 at file build/test/data/dfs/data/data1/current/blk_-4993244343269496237
2013-10-31 18:32:45,647 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data2/current/blk_7445994968599272333
2013-10-31 18:32:45,646 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0010,submitTime=1383244333322,launchTime=1383244333702,firstMapTaskLaunchTime=1383244340329,firstJobSetupTaskLaunchTime=1383244334290,firstJobCleanupTaskLaunchTime=1383244358227,finishTime=1383244365646,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=56,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3CB815650E6B4FC3B298C6C9B575DB86/8798AD252BB0435C9E93091132D74BF5] left+right/(3/3) ...pesplatform/nonsafesplit1
2013-10-31 18:32:45,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data3/current/blk_-4134747532649829860
2013-10-31 18:32:45,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4081485762383124586_1085 at file build/test/data/dfs/data/data3/current/blk_-4081485762383124586
2013-10-31 18:32:45,654 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C. blk_-1349162633554632614_1104
2013-10-31 18:32:45,654 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3808353552338567285_1088 at file build/test/data/dfs/data/data3/current/blk_3808353552338567285
2013-10-31 18:32:45,658 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data3/current/blk_7445994968599272333
2013-10-31 18:32:45,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1349162633554632614_1104 src: /127.0.0.1:47199 dest: /127.0.0.1:54365
2013-10-31 18:32:45,661 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1349162633554632614_1104 src: /127.0.0.1:43026 dest: /127.0.0.1:59471
2013-10-31 18:32:45,663 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1349162633554632614_1104 src: /127.0.0.1:46918 dest: /127.0.0.1:37740
2013-10-31 18:32:45,664 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data1/current/blk_-4134747532649829860
2013-10-31 18:32:45,673 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46918, dest: /127.0.0.1:37740, bytes: 21381, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1349162633554632614_1104, duration: 5952423
2013-10-31 18:32:45,673 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1349162633554632614_1104 terminating
2013-10-31 18:32:45,674 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43026, dest: /127.0.0.1:59471, bytes: 21381, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1349162633554632614_1104, duration: 3990960
2013-10-31 18:32:45,674 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1349162633554632614_1104 terminating
2013-10-31 18:32:45,675 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47199, dest: /127.0.0.1:54365, bytes: 21381, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1349162633554632614_1104, duration: 6948512
2013-10-31 18:32:45,675 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1349162633554632614_1104 terminating
2013-10-31 18:32:45,678 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1349162633554632614_1104 size 21381
2013-10-31 18:32:45,679 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1349162633554632614_1104 size 21381
2013-10-31 18:32:45,679 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1349162633554632614_1104 size 21381
2013-10-31 18:32:45,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data4/current/blk_1765133373633960270
2013-10-31 18:32:46,079 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C from client DFSClient_-1859484039
2013-10-31 18:32:46,079 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C is closed by DFSClient_-1859484039
2013-10-31 18:32:46,085 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,086 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000003_0'
2013-10-31 18:32:46,086 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000004_0'
2013-10-31 18:32:46,088 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000001_0'
2013-10-31 18:32:46,088 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_726165482891072064 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,088 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000002_0'
2013-10-31 18:32:46,089 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_726165482891072064 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,089 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000004_0' has completed task_20131031182606197_0009_m_000004 successfully.
2013-10-31 18:32:46,089 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_726165482891072064 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,090 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0009 has completed successfully.
2013-10-31 18:32:46,091 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0009,submitTime=1383244333260,launchTime=1383244333624,firstMapTaskLaunchTime=1383244340192,firstJobSetupTaskLaunchTime=1383244334176,firstJobCleanupTaskLaunchTime=1383244358357,finishTime=1383244366090,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=66,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3CB815650E6B4FC3B298C6C9B575DB86/AA9F83F00E7342EFB347F9FE5B8337F4] left+right/(2/3) ...pesplatform/nonsafesplit2
2013-10-31 18:32:46,092 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0010_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010	dst=null	perm=null
2013-10-31 18:32:46,097 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF. blk_-7021182400753421927_1104
2013-10-31 18:32:46,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021182400753421927_1104 src: /127.0.0.1:43029 dest: /127.0.0.1:59471
2013-10-31 18:32:46,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021182400753421927_1104 src: /127.0.0.1:46921 dest: /127.0.0.1:37740
2013-10-31 18:32:46,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021182400753421927_1104 src: /127.0.0.1:49835 dest: /127.0.0.1:34578
2013-10-31 18:32:46,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49835, dest: /127.0.0.1:34578, bytes: 21705, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7021182400753421927_1104, duration: 89813
2013-10-31 18:32:46,105 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7021182400753421927_1104 terminating
2013-10-31 18:32:46,105 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7021182400753421927_1104 size 21705
2013-10-31 18:32:46,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46921, dest: /127.0.0.1:37740, bytes: 21705, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7021182400753421927_1104, duration: 863378
2013-10-31 18:32:46,106 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7021182400753421927_1104 size 21705
2013-10-31 18:32:46,106 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7021182400753421927_1104 terminating
2013-10-31 18:32:46,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43029, dest: /127.0.0.1:59471, bytes: 21705, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7021182400753421927_1104, duration: 1976435
2013-10-31 18:32:46,107 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7021182400753421927_1104 terminating
2013-10-31 18:32:46,110 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF from client DFSClient_-636476314
2013-10-31 18:32:46,110 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF is closed by DFSClient_-636476314
2013-10-31 18:32:46,111 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7021182400753421927_1104 size 21705
2013-10-31 18:32:46,117 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000003_0'
2013-10-31 18:32:46,117 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6152330823190221756 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,117 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000004_0'
2013-10-31 18:32:46,117 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6152330823190221756 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,118 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000000_0'
2013-10-31 18:32:46,118 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6152330823190221756 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,119 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000001_0'
2013-10-31 18:32:46,119 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000002_0'
2013-10-31 18:32:46,119 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000005_0'
2013-10-31 18:32:46,120 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009	dst=null	perm=null
2013-10-31 18:32:46,125 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0009_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,166 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8232283085439151097 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,166 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8232283085439151097 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,166 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8232283085439151097 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,166 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2396101614590861125 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,167 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2396101614590861125 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,167 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2396101614590861125 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,167 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7738361136727118235 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,167 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7738361136727118235 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,168 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7738361136727118235 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,168 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-257311796089327943 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,168 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-257311796089327943 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,168 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-257311796089327943 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,168 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7731653809023951984 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,169 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7731653809023951984 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,169 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7731653809023951984 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,169 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4349690085078030343 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,169 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4349690085078030343 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,170 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4349690085078030343 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34	dst=null	perm=null
2013-10-31 18:32:46,176 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary
2013-10-31 18:32:46,177 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary
2013-10-31 18:32:46,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1	dst=null	perm=null
2013-10-31 18:32:46,199 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:46,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000	dst=null	perm=null
2013-10-31 18:32:46,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001	dst=null	perm=null
2013-10-31 18:32:46,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002	dst=null	perm=null
2013-10-31 18:32:46,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003	dst=null	perm=null
2013-10-31 18:32:46,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000	dst=null	perm=null
2013-10-31 18:32:46,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001	dst=null	perm=null
2013-10-31 18:32:46,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002	dst=null	perm=null
2013-10-31 18:32:46,207 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49836, bytes: 134, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3055933182081159268_1096, duration: 303541
2013-10-31 18:32:46,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003	dst=null	perm=null
2013-10-31 18:32:46,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2	dst=null	perm=null
2013-10-31 18:32:46,217 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:46,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000	dst=null	perm=null
2013-10-31 18:32:46,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001	dst=null	perm=null
2013-10-31 18:32:46,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002	dst=null	perm=null
2013-10-31 18:32:46,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003	dst=null	perm=null
2013-10-31 18:32:46,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000	dst=null	perm=null
2013-10-31 18:32:46,224 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46925, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5467518339498007322_1095, duration: 180470
2013-10-31 18:32:46,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001	dst=null	perm=null
2013-10-31 18:32:46,226 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43035, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8597259860310358460_1102, duration: 148924
2013-10-31 18:32:46,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002	dst=null	perm=null
2013-10-31 18:32:46,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003	dst=null	perm=null
2013-10-31 18:32:46,228 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/nonsafesplit2
2013-10-31 18:32:46,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2	dst=null	perm=null
2013-10-31 18:32:46,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000	dst=null	perm=null
2013-10-31 18:32:46,235 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43036, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5467518339498007322_1095, duration: 211121
2013-10-31 18:32:46,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001	dst=null	perm=null
2013-10-31 18:32:46,238 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43037, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8597259860310358460_1102, duration: 156390
2013-10-31 18:32:46,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002	dst=null	perm=null
2013-10-31 18:32:46,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003	dst=null	perm=null
2013-10-31 18:32:46,243 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/nonsafesplit1
2013-10-31 18:32:46,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1	dst=null	perm=null
2013-10-31 18:32:46,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000	dst=null	perm=null
2013-10-31 18:32:46,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001	dst=null	perm=null
2013-10-31 18:32:46,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002	dst=null	perm=null
2013-10-31 18:32:46,257 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43038, bytes: 134, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3055933182081159268_1096, duration: 276335
2013-10-31 18:32:46,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003	dst=null	perm=null
2013-10-31 18:32:46,279 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:32:46,279 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:32:46,299 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] starting
2013-10-31 18:32:46,300 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2]  source: Hfs["TextLine[['num', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:32:46,300 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2"]
2013-10-31 18:32:46,301 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1"]
2013-10-31 18:32:46,301 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2]  parallel execution is enabled: true
2013-10-31 18:32:46,301 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2]  starting jobs: 3
2013-10-31 18:32:46,301 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2]  allocating threads: 3
2013-10-31 18:32:46,303 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] starting step: (1/3)
2013-10-31 18:32:46,307 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:32:46,307 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:32:46,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:46,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:32:46,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,327 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar. blk_-1646609186769667995_1105
2013-10-31 18:32:46,329 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:43039 dest: /127.0.0.1:59471
2013-10-31 18:32:46,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:49843 dest: /127.0.0.1:34578
2013-10-31 18:32:46,331 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:46932 dest: /127.0.0.1:37740
2013-10-31 18:32:46,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46932, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1646609186769667995_1105, duration: 4743523
2013-10-31 18:32:46,337 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1646609186769667995_1105 terminating
2013-10-31 18:32:46,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49843, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1646609186769667995_1105, duration: 3922146
2013-10-31 18:32:46,337 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1646609186769667995_1105 terminating
2013-10-31 18:32:46,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43039, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1646609186769667995_1105, duration: 4806708
2013-10-31 18:32:46,338 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:46,338 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1646609186769667995_1105 terminating
2013-10-31 18:32:46,339 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar from client DFSClient_-1596270109
2013-10-31 18:32:46,340 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:32:46,340 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:46,342 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:46,344 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar. New replication is 10
2013-10-31 18:32:46,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=null
2013-10-31 18:32:46,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,357 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:32:46,362 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:32:46,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:32:46,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,375 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split. New replication is 10
2013-10-31 18:32:46,402 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-1646609186769667995_1105 to datanode(s) 127.0.0.1:54365
2013-10-31 18:32:46,402 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_4349690085078030343_1079 blk_726165482891072064_1094 blk_7731653809023951984_1077 blk_-8232283085439151097_1080 blk_7738361136727118235_1077 blk_-6152330823190221756_1091
2013-10-31 18:32:46,403 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_4349690085078030343_1079 blk_-2396101614590861125_1074 blk_-257311796089327943_1079 blk_726165482891072064_1094 blk_7731653809023951984_1077 blk_-8232283085439151097_1080 blk_7738361136727118235_1077
2013-10-31 18:32:47,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=null
2013-10-31 18:32:47,243 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split. blk_4636075907529433197_1106
2013-10-31 18:32:47,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:47216 dest: /127.0.0.1:54365
2013-10-31 18:32:47,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:43043 dest: /127.0.0.1:59471
2013-10-31 18:32:47,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:49847 dest: /127.0.0.1:34578
2013-10-31 18:32:47,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:46936 dest: /127.0.0.1:37740
2013-10-31 18:32:47,253 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46936, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4636075907529433197_1106, duration: 113985
2013-10-31 18:32:47,254 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,254 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49847, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4636075907529433197_1106, duration: 955590
2013-10-31 18:32:47,255 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43043, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4636075907529433197_1106, duration: 1950244
2013-10-31 18:32:47,255 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,256 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47216, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4636075907529433197_1106, duration: 2790715
2013-10-31 18:32:47,256 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,258 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,260 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,260 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split from client DFSClient_-1596270109
2013-10-31 18:32:47,261 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split is closed by DFSClient_-1596270109
2013-10-31 18:32:47,261 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,276 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo. blk_1473407138158581377_1107
2013-10-31 18:32:47,277 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1473407138158581377_1107 src: /127.0.0.1:49849 dest: /127.0.0.1:34578
2013-10-31 18:32:47,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1473407138158581377_1107 src: /127.0.0.1:47221 dest: /127.0.0.1:54365
2013-10-31 18:32:47,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1473407138158581377_1107 src: /127.0.0.1:43048 dest: /127.0.0.1:59471
2013-10-31 18:32:47,284 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43048, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1473407138158581377_1107, duration: 69079
2013-10-31 18:32:47,284 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1473407138158581377_1107 terminating
2013-10-31 18:32:47,284 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47221, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1473407138158581377_1107, duration: 868210
2013-10-31 18:32:47,285 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1473407138158581377_1107 terminating
2013-10-31 18:32:47,285 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49849, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1473407138158581377_1107, duration: 1740711
2013-10-31 18:32:47,286 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1473407138158581377_1107 size 156
2013-10-31 18:32:47,286 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1473407138158581377_1107 terminating
2013-10-31 18:32:47,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1473407138158581377_1107 size 156
2013-10-31 18:32:47,288 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1473407138158581377_1107 size 156
2013-10-31 18:32:47,289 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:32:47,289 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:32:47,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,312 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml. blk_-5658866385858982902_1108
2013-10-31 18:32:47,314 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5658866385858982902_1108 src: /127.0.0.1:47223 dest: /127.0.0.1:54365
2013-10-31 18:32:47,315 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5658866385858982902_1108 src: /127.0.0.1:49853 dest: /127.0.0.1:34578
2013-10-31 18:32:47,317 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5658866385858982902_1108 src: /127.0.0.1:43051 dest: /127.0.0.1:59471
2013-10-31 18:32:47,320 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43051, dest: /127.0.0.1:59471, bytes: 27679, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5658866385858982902_1108, duration: 194618
2013-10-31 18:32:47,320 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5658866385858982902_1108 terminating
2013-10-31 18:32:47,321 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49853, dest: /127.0.0.1:34578, bytes: 27679, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5658866385858982902_1108, duration: 961673
2013-10-31 18:32:47,321 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5658866385858982902_1108 terminating
2013-10-31 18:32:47,321 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5658866385858982902_1108 size 27679
2013-10-31 18:32:47,321 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47223, dest: /127.0.0.1:54365, bytes: 27679, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5658866385858982902_1108, duration: 1822365
2013-10-31 18:32:47,322 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5658866385858982902_1108 size 27679
2013-10-31 18:32:47,322 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5658866385858982902_1108 terminating
2013-10-31 18:32:47,326 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml from client DFSClient_-1596270109
2013-10-31 18:32:47,326 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:32:47,327 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5658866385858982902_1108 size 27679
2013-10-31 18:32:47,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=null
2013-10-31 18:32:47,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43053, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-368931034, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5658866385858982902_1108, duration: 396741
2013-10-31 18:32:47,359 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0011: nMaps=4 nReduces=1 max=-1
2013-10-31 18:32:47,360 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0011 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:32:47,360 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0011	RESULT=SUCCESS
2013-10-31 18:32:47,360 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0011
2013-10-31 18:32:47,360 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0011
2013-10-31 18:32:47,360 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] submitted hadoop job: job_20131031182606197_0011
2013-10-31 18:32:47,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,380 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml. blk_-3041080366967563833_1110
2013-10-31 18:32:47,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3041080366967563833_1110 src: /127.0.0.1:47228 dest: /127.0.0.1:54365
2013-10-31 18:32:47,382 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3041080366967563833_1110 src: /127.0.0.1:43055 dest: /127.0.0.1:59471
2013-10-31 18:32:47,382 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3041080366967563833_1110 src: /127.0.0.1:49859 dest: /127.0.0.1:34578
2013-10-31 18:32:47,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49859, dest: /127.0.0.1:34578, bytes: 27744, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3041080366967563833_1110, duration: 658932
2013-10-31 18:32:47,385 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3041080366967563833_1110 terminating
2013-10-31 18:32:47,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43055, dest: /127.0.0.1:59471, bytes: 27744, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3041080366967563833_1110, duration: 1481855
2013-10-31 18:32:47,386 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3041080366967563833_1110 terminating
2013-10-31 18:32:47,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47228, dest: /127.0.0.1:54365, bytes: 27744, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3041080366967563833_1110, duration: 1866504
2013-10-31 18:32:47,386 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3041080366967563833_1110 terminating
2013-10-31 18:32:47,389 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3041080366967563833_1110 size 27744
2013-10-31 18:32:47,389 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml from client DFSClient_-368931034
2013-10-31 18:32:47,389 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml is closed by DFSClient_-368931034
2013-10-31 18:32:47,390 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3041080366967563833_1110 size 27744
2013-10-31 18:32:47,390 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3041080366967563833_1110 size 27744
2013-10-31 18:32:47,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,400 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken. blk_7656384865086930476_1111
2013-10-31 18:32:47,402 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7656384865086930476_1111 src: /127.0.0.1:49860 dest: /127.0.0.1:34578
2013-10-31 18:32:47,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7656384865086930476_1111 src: /127.0.0.1:46949 dest: /127.0.0.1:37740
2013-10-31 18:32:47,405 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7656384865086930476_1111 src: /127.0.0.1:43059 dest: /127.0.0.1:59471
2013-10-31 18:32:47,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43059, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7656384865086930476_1111, duration: 69500
2013-10-31 18:32:47,408 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7656384865086930476_1111 terminating
2013-10-31 18:32:47,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46949, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7656384865086930476_1111, duration: 858730
2013-10-31 18:32:47,409 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7656384865086930476_1111 terminating
2013-10-31 18:32:47,409 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7656384865086930476_1111 size 116
2013-10-31 18:32:47,409 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49860, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 1822027
2013-10-31 18:32:47,410 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7656384865086930476_1111 size 116
2013-10-31 18:32:47,411 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7656384865086930476_1111 terminating
2013-10-31 18:32:47,412 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7656384865086930476_1111 size 116
2013-10-31 18:32:47,413 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken from client DFSClient_-1596270109
2013-10-31 18:32:47,413 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:32:47,418 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken
2013-10-31 18:32:47,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:32:47,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47234, bytes: 160, op: HDFS_READ, cliID: DFSClient_-368931034, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1473407138158581377_1107, duration: 269435
2013-10-31 18:32:47,423 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0011 = 1449. Number of splits = 4
2013-10-31 18:32:47,423 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0011 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:32:47,427 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0011 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:32:47,764 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-1646609186769667995_1105 to 127.0.0.1:54365 
2013-10-31 18:32:47,764 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8232283085439151097_1080 file build/test/data/dfs/data/data5/current/blk_-8232283085439151097 for deletion
2013-10-31 18:32:47,765 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6152330823190221756_1091 file build/test/data/dfs/data/data6/current/blk_-6152330823190221756 for deletion
2013-10-31 18:32:47,765 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8232283085439151097_1080 at file build/test/data/dfs/data/data5/current/blk_-8232283085439151097
2013-10-31 18:32:47,765 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6152330823190221756_1091 at file build/test/data/dfs/data/data6/current/blk_-6152330823190221756
2013-10-31 18:32:47,765 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_726165482891072064_1094 file build/test/data/dfs/data/data6/current/blk_726165482891072064 for deletion
2013-10-31 18:32:47,766 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4349690085078030343_1079 file build/test/data/dfs/data/data6/current/blk_4349690085078030343 for deletion
2013-10-31 18:32:47,766 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:47235 dest: /127.0.0.1:54365
2013-10-31 18:32:47,766 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7731653809023951984_1077 file build/test/data/dfs/data/data5/current/blk_7731653809023951984 for deletion
2013-10-31 18:32:47,766 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_726165482891072064_1094 at file build/test/data/dfs/data/data6/current/blk_726165482891072064
2013-10-31 18:32:47,767 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7731653809023951984_1077 at file build/test/data/dfs/data/data5/current/blk_7731653809023951984
2013-10-31 18:32:47,767 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4349690085078030343_1079 at file build/test/data/dfs/data/data6/current/blk_4349690085078030343
2013-10-31 18:32:47,767 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7738361136727118235_1077 file build/test/data/dfs/data/data6/current/blk_7738361136727118235 for deletion
2013-10-31 18:32:47,767 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-1646609186769667995_1105 to /127.0.0.1:54365
2013-10-31 18:32:47,768 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7738361136727118235_1077 at file build/test/data/dfs/data/data6/current/blk_7738361136727118235
2013-10-31 18:32:47,769 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1646609186769667995_1105 src: /127.0.0.1:47235 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:32:47,774 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:48,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8232283085439151097_1080 file build/test/data/dfs/data/data7/current/blk_-8232283085439151097 for deletion
2013-10-31 18:32:48,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2396101614590861125_1074 file build/test/data/dfs/data/data7/current/blk_-2396101614590861125 for deletion
2013-10-31 18:32:48,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8232283085439151097_1080 at file build/test/data/dfs/data/data7/current/blk_-8232283085439151097
2013-10-31 18:32:48,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-257311796089327943_1079 file build/test/data/dfs/data/data8/current/blk_-257311796089327943 for deletion
2013-10-31 18:32:48,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2396101614590861125_1074 at file build/test/data/dfs/data/data7/current/blk_-2396101614590861125
2013-10-31 18:32:48,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_726165482891072064_1094 file build/test/data/dfs/data/data7/current/blk_726165482891072064 for deletion
2013-10-31 18:32:48,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-257311796089327943_1079 at file build/test/data/dfs/data/data8/current/blk_-257311796089327943
2013-10-31 18:32:48,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4349690085078030343_1079 file build/test/data/dfs/data/data7/current/blk_4349690085078030343 for deletion
2013-10-31 18:32:48,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_726165482891072064_1094 at file build/test/data/dfs/data/data7/current/blk_726165482891072064
2013-10-31 18:32:48,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7731653809023951984_1077 file build/test/data/dfs/data/data7/current/blk_7731653809023951984 for deletion
2013-10-31 18:32:48,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4349690085078030343_1079 at file build/test/data/dfs/data/data7/current/blk_4349690085078030343
2013-10-31 18:32:48,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7738361136727118235_1077 file build/test/data/dfs/data/data8/current/blk_7738361136727118235 for deletion
2013-10-31 18:32:48,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7731653809023951984_1077 at file build/test/data/dfs/data/data7/current/blk_7731653809023951984
2013-10-31 18:32:48,237 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7738361136727118235_1077 at file build/test/data/dfs/data/data8/current/blk_7738361136727118235
2013-10-31 18:32:49,092 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0011_m_000005_0' to tip task_20131031182606197_0011_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:49,097 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000000_0'
2013-10-31 18:32:49,097 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000005_0'
2013-10-31 18:32:49,100 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:32:49,100 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000005_0 which needs 1 slots
2013-10-31 18:32:49,100 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000005_0 which needs 1 slots
2013-10-31 18:32:49,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken	dst=null	perm=null
2013-10-31 18:32:49,109 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49865, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 317494
2013-10-31 18:32:49,109 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 66 raw values into 2 aggregated values, total 6
2013-10-31 18:32:49,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=null
2013-10-31 18:32:49,120 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47238, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-324736910, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5658866385858982902_1108, duration: 399692
2013-10-31 18:32:49,149 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:49,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=null
2013-10-31 18:32:49,184 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49868, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-324736910, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1646609186769667995_1105, duration: 1796035
2013-10-31 18:32:49,279 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:49,286 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22279 with signal TERM. Exit code 0
2013-10-31 18:32:49,286 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_-575970400
2013-10-31 18:32:49,289 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_-575970400 spawned.
2013-10-31 18:32:49,290 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000005_0/taskjvm.sh
2013-10-31 18:32:49,403 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_4349690085078030343_1079 blk_-2396101614590861125_1074 blk_-257311796089327943_1079 blk_726165482891072064_1094 blk_7731653809023951984_1077 blk_7738361136727118235_1077 blk_-6152330823190221756_1091
2013-10-31 18:32:49,404 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-2396101614590861125_1074 blk_-257311796089327943_1079 blk_-8232283085439151097_1080 blk_-6152330823190221756_1091
2013-10-31 18:32:49,959 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:50,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8232283085439151097_1080 file build/test/data/dfs/data/data3/current/blk_-8232283085439151097 for deletion
2013-10-31 18:32:50,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6152330823190221756_1091 file build/test/data/dfs/data/data3/current/blk_-6152330823190221756 for deletion
2013-10-31 18:32:50,036 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8232283085439151097_1080 at file build/test/data/dfs/data/data3/current/blk_-8232283085439151097
2013-10-31 18:32:50,037 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2396101614590861125_1074 file build/test/data/dfs/data/data4/current/blk_-2396101614590861125 for deletion
2013-10-31 18:32:50,037 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6152330823190221756_1091 at file build/test/data/dfs/data/data3/current/blk_-6152330823190221756
2013-10-31 18:32:50,037 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-257311796089327943_1079 file build/test/data/dfs/data/data4/current/blk_-257311796089327943 for deletion
2013-10-31 18:32:50,037 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2396101614590861125_1074 at file build/test/data/dfs/data/data4/current/blk_-2396101614590861125
2013-10-31 18:32:50,038 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-257311796089327943_1079 at file build/test/data/dfs/data/data4/current/blk_-257311796089327943
2013-10-31 18:32:50,667 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:50,668 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:50,668 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:50,668 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_-775097629 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:32:51,088 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:51,088 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000003_0 not found in cache
2013-10-31 18:32:51,089 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000004_0 not found in cache
2013-10-31 18:32:51,089 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330771089
2013-10-31 18:32:51,089 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:51,090 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000002_0 not found in cache
2013-10-31 18:32:51,090 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000001_0 not found in cache
2013-10-31 18:32:51,090 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330771090
2013-10-31 18:32:51,090 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:51,090 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0009 being deleted.
2013-10-31 18:32:51,119 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:51,119 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000004_0 not found in cache
2013-10-31 18:32:51,119 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000003_0 not found in cache
2013-10-31 18:32:51,120 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383330771119
2013-10-31 18:32:51,120 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:51,120 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000001_0 not found in cache
2013-10-31 18:32:51,120 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000002_0 not found in cache
2013-10-31 18:32:51,121 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383330771121
2013-10-31 18:32:51,162 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6152330823190221756_1091 file build/test/data/dfs/data/data1/current/blk_-6152330823190221756 for deletion
2013-10-31 18:32:51,162 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6152330823190221756_1091 at file build/test/data/dfs/data/data1/current/blk_-6152330823190221756
2013-10-31 18:32:51,162 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2396101614590861125_1074 file build/test/data/dfs/data/data2/current/blk_-2396101614590861125 for deletion
2013-10-31 18:32:51,162 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2396101614590861125_1074 at file build/test/data/dfs/data/data2/current/blk_-2396101614590861125
2013-10-31 18:32:51,162 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-257311796089327943_1079 file build/test/data/dfs/data/data1/current/blk_-257311796089327943 for deletion
2013-10-31 18:32:51,163 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-257311796089327943_1079 at file build/test/data/dfs/data/data1/current/blk_-257311796089327943
2013-10-31 18:32:51,163 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_726165482891072064_1094 file build/test/data/dfs/data/data1/current/blk_726165482891072064 for deletion
2013-10-31 18:32:51,163 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_726165482891072064_1094 at file build/test/data/dfs/data/data1/current/blk_726165482891072064
2013-10-31 18:32:51,163 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4349690085078030343_1079 file build/test/data/dfs/data/data2/current/blk_4349690085078030343 for deletion
2013-10-31 18:32:51,164 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4349690085078030343_1079 at file build/test/data/dfs/data/data2/current/blk_4349690085078030343
2013-10-31 18:32:51,164 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7731653809023951984_1077 file build/test/data/dfs/data/data1/current/blk_7731653809023951984 for deletion
2013-10-31 18:32:51,164 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7731653809023951984_1077 at file build/test/data/dfs/data/data1/current/blk_7731653809023951984
2013-10-31 18:32:51,164 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7738361136727118235_1077 file build/test/data/dfs/data/data2/current/blk_7738361136727118235 for deletion
2013-10-31 18:32:51,164 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7738361136727118235_1077 at file build/test/data/dfs/data/data2/current/blk_7738361136727118235
2013-10-31 18:32:51,353 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_-575970400 given task: attempt_20131031182606197_0011_m_000005_0
2013-10-31 18:32:51,506 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_1345701271 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:51,511 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22284 with signal TERM. Exit code 0
2013-10-31 18:32:51,650 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:51,650 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:51,651 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:51,651 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_1345701271 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:32:51,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:51,932 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0010_m_1371704024 since job job_20131031182606197_0010 is dead
2013-10-31 18:32:51,941 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22242 with signal TERM. Exit code 0
2013-10-31 18:32:52,134 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,134 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,134 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:52,134 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_1371704024 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:52,278 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_-760035825 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:52,288 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22283 with signal TERM. Exit code 0
2013-10-31 18:32:52,334 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0010_m_1071625860 since job job_20131031182606197_0010 is dead
2013-10-31 18:32:52,342 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22282 with signal TERM. Exit code 0
2013-10-31 18:32:52,357 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_-1154774997 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:52,362 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22280 with signal TERM. Exit code 0
2013-10-31 18:32:52,508 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,509 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,509 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:52,509 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_-760035825 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:52,529 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,529 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,529 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:52,529 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_1071625860 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:52,537 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,537 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,537 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:52,537 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_-1154774997 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:54,776 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000005_0 0.0% setup
2013-10-31 18:32:54,780 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000005_0 is done.
2013-10-31 18:32:54,781 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000005_0  was -1
2013-10-31 18:32:54,781 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:55,105 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000005_0' has completed task_20131031182606197_0011_m_000005 successfully.
2013-10-31 18:32:55,108 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000000_0' to tip task_20131031182606197_0011_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:55,109 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000000
2013-10-31 18:32:55,111 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:32:55,111 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000000_0 which needs 1 slots
2013-10-31 18:32:55,112 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000000_0 which needs 1 slots
2013-10-31 18:32:55,128 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000001_0' to tip task_20131031182606197_0011_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:55,128 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000001
2013-10-31 18:32:55,130 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:32:55,130 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000002_0' to tip task_20131031182606197_0011_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:55,130 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000001_0 which needs 1 slots
2013-10-31 18:32:55,131 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000001_0 which needs 1 slots
2013-10-31 18:32:55,131 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000002
2013-10-31 18:32:55,133 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:32:55,133 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000002_0 which needs 1 slots
2013-10-31 18:32:55,133 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000002_0 which needs 1 slots
2013-10-31 18:32:55,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken	dst=null	perm=null
2013-10-31 18:32:55,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken	dst=null	perm=null
2013-10-31 18:32:55,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49872, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 144122
2013-10-31 18:32:55,164 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43070, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7656384865086930476_1111, duration: 911446
2013-10-31 18:32:55,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=null
2013-10-31 18:32:55,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=null
2013-10-31 18:32:55,169 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43073, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-764662643, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5658866385858982902_1108, duration: 168873
2013-10-31 18:32:55,171 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49877, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-1527887059, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5658866385858982902_1108, duration: 411774
2013-10-31 18:32:55,176 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0011/attempt_20131031182606197_0011_m_000000_0. Attempting to reuse: jvm_20131031182606197_0011_m_-575970400
2013-10-31 18:32:55,185 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:55,189 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:55,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=null
2013-10-31 18:32:55,201 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43075, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1527887059, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1646609186769667995_1105, duration: 606197
2013-10-31 18:32:55,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=null
2013-10-31 18:32:55,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47250, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-764662643, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1646609186769667995_1105, duration: 629820
2013-10-31 18:32:55,258 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_-538677001
2013-10-31 18:32:55,259 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_-538677001 spawned.
2013-10-31 18:32:55,260 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000002_0/taskjvm.sh
2013-10-31 18:32:55,269 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_1012864139
2013-10-31 18:32:55,269 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_1012864139 spawned.
2013-10-31 18:32:55,270 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000001_0/taskjvm.sh
2013-10-31 18:32:55,466 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_-575970400 given task: attempt_20131031182606197_0011_m_000000_0
2013-10-31 18:32:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:32:56,020 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,031 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,036 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,042 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,047 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 18:32:56,089 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:56,089 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000000_0 not found in cache
2013-10-31 18:32:56,090 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383330776090
2013-10-31 18:32:56,120 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:56,120 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000000_0 not found in cache
2013-10-31 18:32:56,121 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330776121
2013-10-31 18:32:56,121 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:56,122 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330776121
2013-10-31 18:32:56,823 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0010_m_-1788039440 since job job_20131031182606197_0010 is dead
2013-10-31 18:32:56,833 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22281 with signal TERM. Exit code 0
2013-10-31 18:32:56,899 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_759702916 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:56,905 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22053 with signal TERM. Exit code 0
2013-10-31 18:32:57,047 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:57,047 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:57,047 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:57,047 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_-1788039440 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:57,079 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:57,079 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:57,079 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:32:57,079 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_759702916 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:57,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=null
2013-10-31 18:32:57,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43078, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4636075907529433197_1106, duration: 371267
2013-10-31 18:32:57,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:32:57,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47253, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 263772
2013-10-31 18:32:58,107 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000003_0' to tip task_20131031182606197_0011_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:58,108 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000003
2013-10-31 18:32:58,109 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:32:58,109 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000003_0 which needs 1 slots
2013-10-31 18:32:58,109 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000003_0 which needs 1 slots
2013-10-31 18:32:58,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken	dst=null	perm=null
2013-10-31 18:32:58,114 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49883, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 153124
2013-10-31 18:32:58,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml	dst=null	perm=null
2013-10-31 18:32:58,118 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47256, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-197170435, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5658866385858982902_1108, duration: 182385
2013-10-31 18:32:58,131 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:58,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar	dst=null	perm=null
2013-10-31 18:32:58,145 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49886, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-197170435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1646609186769667995_1105, duration: 610040
2013-10-31 18:32:58,202 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_116991220
2013-10-31 18:32:58,203 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_116991220 spawned.
2013-10-31 18:32:58,205 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000003_0/taskjvm.sh
2013-10-31 18:32:58,432 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_-538677001 given task: attempt_20131031182606197_0011_m_000002_0
2013-10-31 18:32:58,484 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_1012864139 given task: attempt_20131031182606197_0011_m_000001_0
2013-10-31 18:32:58,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=null
2013-10-31 18:32:58,946 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47262, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4636075907529433197_1106, duration: 173941
2013-10-31 18:32:58,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=null
2013-10-31 18:32:58,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:32:58,985 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49893, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 164032
2013-10-31 18:32:58,985 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47263, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4636075907529433197_1106, duration: 190872
2013-10-31 18:32:59,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:32:59,244 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46982, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 180332
2013-10-31 18:33:00,457 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:33:00,461 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000000_0 is done.
2013-10-31 18:33:00,461 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000000_0  was 353
2013-10-31 18:33:00,461 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:01,090 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0011_m_000005_0
2013-10-31 18:33:01,091 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0011_m_000005_0
2013-10-31 18:33:01,091 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0011_m_000005_0 not found in cache
2013-10-31 18:33:01,116 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000000_0' has completed task_20131031182606197_0011_m_000000 successfully.
2013-10-31 18:33:01,117 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0011_r_000000_0' to tip task_20131031182606197_0011_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:01,119 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:01,119 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_r_000000_0 which needs 1 slots
2013-10-31 18:33:01,119 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_r_000000_0 which needs 1 slots
2013-10-31 18:33:01,159 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_r_1328977401
2013-10-31 18:33:01,160 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_r_1328977401 spawned.
2013-10-31 18:33:01,161 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_r_000000_0/taskjvm.sh
2013-10-31 18:33:01,811 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_116991220 given task: attempt_20131031182606197_0011_m_000003_0
2013-10-31 18:33:01,873 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:33:01,874 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000002_0 is done.
2013-10-31 18:33:01,874 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000002_0  was 481
2013-10-31 18:33:01,874 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:01,908 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:33:01,909 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000001_0 is done.
2013-10-31 18:33:01,909 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000001_0  was 436
2013-10-31 18:33:01,909 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:02,122 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_r_1328977401 given task: attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:02,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split	dst=null	perm=null
2013-10-31 18:33:02,318 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43095, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4636075907529433197_1106, duration: 138566
2013-10-31 18:33:02,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:33:02,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49899, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 152969
2013-10-31 18:33:04,137 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000001_0' has completed task_20131031182606197_0011_m_000001 successfully.
2013-10-31 18:33:04,140 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000002_0' has completed task_20131031182606197_0011_m_000002 successfully.
2013-10-31 18:33:05,242 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:33:05,245 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000003_0 is done.
2013-10-31 18:33:05,245 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000003_0  was 341
2013-10-31 18:33:05,245 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:07,119 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000003_0' has completed task_20131031182606197_0011_m_000003 successfully.
2013-10-31 18:33:07,813 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48937, bytes: 353, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000000_0, duration: 8509094
2013-10-31 18:33:07,839 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41304, bytes: 436, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000001_0, duration: 13335365
2013-10-31 18:33:07,858 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39284, bytes: 481, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000002_0, duration: 13278874
2013-10-31 18:33:08,626 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) > 
2013-10-31 18:33:10,128 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   3 OK for attempt_20131031182606197_0011_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:33:11,677 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) > 
2013-10-31 18:33:12,883 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43982, bytes: 341, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000003_0, duration: 14726197
2013-10-31 18:33:13,690 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) > 
2013-10-31 18:33:13,751 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) > 
2013-10-31 18:33:13,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:13,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:13,967 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000. blk_1328316139791502870_1112
2013-10-31 18:33:14,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1328316139791502870_1112 src: /127.0.0.1:43104 dest: /127.0.0.1:59471
2013-10-31 18:33:14,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1328316139791502870_1112 src: /127.0.0.1:49908 dest: /127.0.0.1:34578
2013-10-31 18:33:14,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1328316139791502870_1112 src: /127.0.0.1:47280 dest: /127.0.0.1:54365
2013-10-31 18:33:14,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47280, dest: /127.0.0.1:54365, bytes: 1697, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0011_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1328316139791502870_1112, duration: 1387858
2013-10-31 18:33:14,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1328316139791502870_1112 terminating
2013-10-31 18:33:14,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49908, dest: /127.0.0.1:34578, bytes: 1697, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0011_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1328316139791502870_1112, duration: 1484862
2013-10-31 18:33:14,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1328316139791502870_1112 terminating
2013-10-31 18:33:14,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43104, dest: /127.0.0.1:59471, bytes: 1697, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0011_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1328316139791502870_1112, duration: 2282553
2013-10-31 18:33:14,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1328316139791502870_1112 terminating
2013-10-31 18:33:14,014 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1328316139791502870_1112 size 1697
2013-10-31 18:33:14,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1328316139791502870_1112 size 1697
2013-10-31 18:33:14,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1328316139791502870_1112 size 1697
2013-10-31 18:33:14,018 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:14,019 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:14,055 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0011_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:33:14,056 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) > 
2013-10-31 18:33:16,136 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0011_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:33:16,137 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:17,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0	dst=null	perm=null
2013-10-31 18:33:17,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:17,722 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:18,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:19,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0	dst=null	perm=null
2013-10-31 18:33:20,761 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:20,762 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:20,763 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_r_000000_0 is done.
2013-10-31 18:33:20,763 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_r_000000_0  was -1
2013-10-31 18:33:20,763 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:22,145 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_r_000000_0' has completed task_20131031182606197_0011_r_000000 successfully.
2013-10-31 18:33:22,150 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0011_m_000004_0' to tip task_20131031182606197_0011_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:22,153 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:33:22,153 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000004_0 which needs 1 slots
2013-10-31 18:33:22,153 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000004_0 which needs 1 slots
2013-10-31 18:33:22,186 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_1263282871
2013-10-31 18:33:22,187 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_1263282871 spawned.
2013-10-31 18:33:22,190 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000004_0/taskjvm.sh
2013-10-31 18:33:23,488 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_1263282871 given task: attempt_20131031182606197_0011_m_000004_0
2013-10-31 18:33:24,025 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000004_0 0.0% 
2013-10-31 18:33:24,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary	dst=null	perm=null
2013-10-31 18:33:24,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:24,047 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_SUCCESS from client DFSClient_attempt_20131031182606197_0011_m_000004_0
2013-10-31 18:33:24,047 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0011_m_000004_0
2013-10-31 18:33:24,053 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,053 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:24,053 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:24,054 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,055 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1473407138158581377 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,055 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1473407138158581377 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,055 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1473407138158581377 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,055 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5658866385858982902 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,056 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5658866385858982902 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,056 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5658866385858982902 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011	dst=null	perm=null
2013-10-31 18:33:25,409 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_1473407138158581377_1107 blk_4636075907529433197_1106 blk_-5658866385858982902_1108 blk_-1646609186769667995_1105
2013-10-31 18:33:25,410 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_4636075907529433197_1106 blk_-1646609186769667995_1105
2013-10-31 18:33:26,777 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5658866385858982902_1108 file build/test/data/dfs/data/data6/current/blk_-5658866385858982902 for deletion
2013-10-31 18:33:26,777 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data5/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:26,777 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5658866385858982902_1108 at file build/test/data/dfs/data/data6/current/blk_-5658866385858982902
2013-10-31 18:33:26,777 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1473407138158581377_1107 file build/test/data/dfs/data/data5/current/blk_1473407138158581377 for deletion
2013-10-31 18:33:26,778 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data5/current/blk_-1646609186769667995
2013-10-31 18:33:26,778 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data6/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:26,778 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1473407138158581377_1107 at file build/test/data/dfs/data/data5/current/blk_1473407138158581377
2013-10-31 18:33:26,778 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data6/current/blk_4636075907529433197
2013-10-31 18:33:26,937 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000004_0 0.0% cleanup
2013-10-31 18:33:26,938 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000004_0 is done.
2013-10-31 18:33:26,938 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000004_0  was -1
2013-10-31 18:33:26,939 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:27,153 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:27,154 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:27,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data8/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:27,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data7/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:27,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data8/current/blk_-1646609186769667995
2013-10-31 18:33:27,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data7/current/blk_4636075907529433197
2013-10-31 18:33:28,160 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000004_0' has completed task_20131031182606197_0011_m_000004 successfully.
2013-10-31 18:33:28,179 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0011 has completed successfully.
2013-10-31 18:33:28,179 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0011,submitTime=1383244367332,launchTime=1383244367427,firstMapTaskLaunchTime=1383244375108,firstReduceTaskLaunchTime=1383244381117,firstJobSetupTaskLaunchTime=1383244369092,firstJobCleanupTaskLaunchTime=1383244402150,finishTime=1383244408179,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=36,reduceSlotsSeconds=19,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7906116797DA4A08896623D5F776AFB9/F143AB928B67435F8F0ECD5AF509F2A0] output1+output2/(1/3)
2013-10-31 18:33:28,192 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F. blk_548298036330803898_1113
2013-10-31 18:33:28,195 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_548298036330803898_1113 src: /127.0.0.1:47002 dest: /127.0.0.1:37740
2013-10-31 18:33:28,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_548298036330803898_1113 src: /127.0.0.1:49915 dest: /127.0.0.1:34578
2013-10-31 18:33:28,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_548298036330803898_1113 src: /127.0.0.1:47287 dest: /127.0.0.1:54365
2013-10-31 18:33:28,210 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47287, dest: /127.0.0.1:54365, bytes: 28334, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_548298036330803898_1113, duration: 7517806
2013-10-31 18:33:28,210 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_548298036330803898_1113 terminating
2013-10-31 18:33:28,210 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_548298036330803898_1113 size 28334
2013-10-31 18:33:28,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49915, dest: /127.0.0.1:34578, bytes: 28334, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_548298036330803898_1113, duration: 6348055
2013-10-31 18:33:28,211 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_548298036330803898_1113 terminating
2013-10-31 18:33:28,212 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47002, dest: /127.0.0.1:37740, bytes: 28334, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_548298036330803898_1113, duration: 5319257
2013-10-31 18:33:28,212 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_548298036330803898_1113 terminating
2013-10-31 18:33:28,212 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_548298036330803898_1113 size 28334
2013-10-31 18:33:28,216 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_548298036330803898_1113 size 28334
2013-10-31 18:33:28,216 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F from client DFSClient_-368931034
2013-10-31 18:33:28,217 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F is closed by DFSClient_-368931034
2013-10-31 18:33:28,217 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 597 Total time for transactions(ms): 15Number of transactions batched in Syncs: 48 Number of syncs: 407 SyncTimes(ms): 52993 12200 
2013-10-31 18:33:28,224 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:28,224 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000000_0'
2013-10-31 18:33:28,224 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000004_0'
2013-10-31 18:33:28,225 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000005_0'
2013-10-31 18:33:28,225 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_r_000000_0'
2013-10-31 18:33:28,226 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7656384865086930476 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:28,226 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7656384865086930476 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:28,227 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000002_0'
2013-10-31 18:33:28,227 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7656384865086930476 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:28,227 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000001_0'
2013-10-31 18:33:28,230 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0011_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:28,233 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] starting step: (2/3) ...edpipesplatform/splitout1
2013-10-31 18:33:28,233 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] starting step: (3/3) ...edpipesplatform/splitout2
2013-10-31 18:33:28,241 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:33:28,241 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:33:28,242 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:33:28,241 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:33:28,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011	dst=null	perm=null
2013-10-31 18:33:28,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:28,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:28,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:33:28,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:33:28,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,275 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar. blk_-3922365374298370577_1115
2013-10-31 18:33:28,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,277 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:47289 dest: /127.0.0.1:54365
2013-10-31 18:33:28,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:49919 dest: /127.0.0.1:34578
2013-10-31 18:33:28,280 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:47008 dest: /127.0.0.1:37740
2013-10-31 18:33:28,294 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47008, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3922365374298370577_1115, duration: 10312202
2013-10-31 18:33:28,294 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3922365374298370577_1115 terminating
2013-10-31 18:33:28,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49919, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3922365374298370577_1115, duration: 11117163
2013-10-31 18:33:28,295 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:28,295 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3922365374298370577_1115 terminating
2013-10-31 18:33:28,296 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47289, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3922365374298370577_1115, duration: 12313742
2013-10-31 18:33:28,296 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:28,297 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3922365374298370577_1115 terminating
2013-10-31 18:33:28,299 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:28,299 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar from client DFSClient_-1596270109
2013-10-31 18:33:28,299 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:33:28,301 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar. blk_3668603729858618955_1115
2013-10-31 18:33:28,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:43118 dest: /127.0.0.1:59471
2013-10-31 18:33:28,305 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:47010 dest: /127.0.0.1:37740
2013-10-31 18:33:28,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:47294 dest: /127.0.0.1:54365
2013-10-31 18:33:28,312 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47294, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3668603729858618955_1115, duration: 2880638
2013-10-31 18:33:28,313 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3668603729858618955_1115 terminating
2013-10-31 18:33:28,313 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:28,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47010, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3668603729858618955_1115, duration: 3647443
2013-10-31 18:33:28,314 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3668603729858618955_1115 terminating
2013-10-31 18:33:28,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43118, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3668603729858618955_1115, duration: 4693794
2013-10-31 18:33:28,315 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:28,315 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3668603729858618955_1115 terminating
2013-10-31 18:33:28,317 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar from client DFSClient_-1596270109
2013-10-31 18:33:28,317 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:33:28,318 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar. New replication is 10
2013-10-31 18:33:28,319 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:28,322 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar. New replication is 10
2013-10-31 18:33:28,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar	dst=null	perm=null
2013-10-31 18:33:28,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar	dst=null	perm=null
2013-10-31 18:33:28,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,332 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:33:28,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,336 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:33:28,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE	dst=null	perm=null
2013-10-31 18:33:28,339 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:33:28,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000	dst=null	perm=null
2013-10-31 18:33:28,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE	dst=null	perm=null
2013-10-31 18:33:28,342 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:33:28,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000	dst=null	perm=null
2013-10-31 18:33:28,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,410 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-3922365374298370577_1115 to datanode(s) 127.0.0.1:59471
2013-10-31 18:33:28,411 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_3668603729858618955_1115 to datanode(s) 127.0.0.1:34578
2013-10-31 18:33:28,411 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_7656384865086930476_1111
2013-10-31 18:33:28,412 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_1473407138158581377_1107 blk_4636075907529433197_1106 blk_-5658866385858982902_1108 blk_-1646609186769667995_1105
2013-10-31 18:33:28,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,872 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split. New replication is 10
2013-10-31 18:33:28,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,875 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split. New replication is 10
2013-10-31 18:33:28,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split	dst=null	perm=null
2013-10-31 18:33:28,879 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split. blk_2114727610416078497_1117
2013-10-31 18:33:28,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split	dst=null	perm=null
2013-10-31 18:33:28,881 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:47295 dest: /127.0.0.1:54365
2013-10-31 18:33:28,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:43122 dest: /127.0.0.1:59471
2013-10-31 18:33:28,884 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:49926 dest: /127.0.0.1:34578
2013-10-31 18:33:28,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:47015 dest: /127.0.0.1:37740
2013-10-31 18:33:28,889 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47015, dest: /127.0.0.1:37740, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2114727610416078497_1117, duration: 65547
2013-10-31 18:33:28,890 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,890 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49926, dest: /127.0.0.1:34578, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2114727610416078497_1117, duration: 898385
2013-10-31 18:33:28,891 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,891 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43122, dest: /127.0.0.1:59471, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2114727610416078497_1117, duration: 1809017
2013-10-31 18:33:28,892 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47295, dest: /127.0.0.1:54365, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2114727610416078497_1117, duration: 2727496
2013-10-31 18:33:28,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,895 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,897 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,898 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,898 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,899 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split from client DFSClient_-1596270109
2013-10-31 18:33:28,899 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split is closed by DFSClient_-1596270109
2013-10-31 18:33:28,899 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split. blk_382693967759542507_1117
2013-10-31 18:33:28,901 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:49928 dest: /127.0.0.1:34578
2013-10-31 18:33:28,903 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:47300 dest: /127.0.0.1:54365
2013-10-31 18:33:28,905 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:47018 dest: /127.0.0.1:37740
2013-10-31 18:33:28,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:43128 dest: /127.0.0.1:59471
2013-10-31 18:33:28,912 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43128, dest: /127.0.0.1:59471, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_382693967759542507_1117, duration: 91784
2013-10-31 18:33:28,912 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47018, dest: /127.0.0.1:37740, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_382693967759542507_1117, duration: 3193444
2013-10-31 18:33:28,913 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47300, dest: /127.0.0.1:54365, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_382693967759542507_1117, duration: 3996111
2013-10-31 18:33:28,914 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49928, dest: /127.0.0.1:34578, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_382693967759542507_1117, duration: 4965647
2013-10-31 18:33:28,915 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,915 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,918 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,919 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,919 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split from client DFSClient_-1596270109
2013-10-31 18:33:28,920 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split is closed by DFSClient_-1596270109
2013-10-31 18:33:28,920 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,937 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo. blk_7462121373986728613_1119
2013-10-31 18:33:28,938 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7462121373986728613_1119 src: /127.0.0.1:49932 dest: /127.0.0.1:34578
2013-10-31 18:33:28,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7462121373986728613_1119 src: /127.0.0.1:43130 dest: /127.0.0.1:59471
2013-10-31 18:33:28,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7462121373986728613_1119 src: /127.0.0.1:47305 dest: /127.0.0.1:54365
2013-10-31 18:33:28,944 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47305, dest: /127.0.0.1:54365, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7462121373986728613_1119, duration: 66350
2013-10-31 18:33:28,945 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7462121373986728613_1119 terminating
2013-10-31 18:33:28,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43130, dest: /127.0.0.1:59471, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7462121373986728613_1119, duration: 842861
2013-10-31 18:33:28,946 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7462121373986728613_1119 terminating
2013-10-31 18:33:28,946 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49932, dest: /127.0.0.1:34578, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7462121373986728613_1119, duration: 1639037
2013-10-31 18:33:28,946 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7462121373986728613_1119 terminating
2013-10-31 18:33:28,948 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7462121373986728613_1119 size 45
2013-10-31 18:33:28,948 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7462121373986728613_1119 size 45
2013-10-31 18:33:28,949 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:33:28,949 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:33:28,950 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7462121373986728613_1119 size 45
2013-10-31 18:33:28,951 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo. blk_-2323677095253206755_1119
2013-10-31 18:33:28,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2323677095253206755_1119 src: /127.0.0.1:49935 dest: /127.0.0.1:34578
2013-10-31 18:33:28,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2323677095253206755_1119 src: /127.0.0.1:47307 dest: /127.0.0.1:54365
2013-10-31 18:33:28,956 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2323677095253206755_1119 src: /127.0.0.1:47025 dest: /127.0.0.1:37740
2013-10-31 18:33:28,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47025, dest: /127.0.0.1:37740, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2323677095253206755_1119, duration: 68331
2013-10-31 18:33:28,959 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2323677095253206755_1119 terminating
2013-10-31 18:33:28,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47307, dest: /127.0.0.1:54365, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2323677095253206755_1119, duration: 1001042
2013-10-31 18:33:28,960 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2323677095253206755_1119 terminating
2013-10-31 18:33:28,960 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49935, dest: /127.0.0.1:34578, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2323677095253206755_1119, duration: 1918657
2013-10-31 18:33:28,961 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2323677095253206755_1119 terminating
2013-10-31 18:33:28,962 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2323677095253206755_1119 size 45
2013-10-31 18:33:28,963 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2323677095253206755_1119 size 45
2013-10-31 18:33:28,964 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:33:28,964 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:33:28,965 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2323677095253206755_1119 size 45
2013-10-31 18:33:28,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,987 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml. blk_-2009759733485207989_1121
2013-10-31 18:33:28,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2009759733485207989_1121 src: /127.0.0.1:43135 dest: /127.0.0.1:59471
2013-10-31 18:33:28,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2009759733485207989_1121 src: /127.0.0.1:47310 dest: /127.0.0.1:54365
2013-10-31 18:33:28,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2009759733485207989_1121 src: /127.0.0.1:49940 dest: /127.0.0.1:34578
2013-10-31 18:33:28,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49940, dest: /127.0.0.1:34578, bytes: 27802, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2009759733485207989_1121, duration: 157061
2013-10-31 18:33:28,995 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2009759733485207989_1121 terminating
2013-10-31 18:33:28,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47310, dest: /127.0.0.1:54365, bytes: 27802, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2009759733485207989_1121, duration: 1037573
2013-10-31 18:33:28,996 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2009759733485207989_1121 terminating
2013-10-31 18:33:28,996 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2009759733485207989_1121 size 27802
2013-10-31 18:33:28,996 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43135, dest: /127.0.0.1:59471, bytes: 27802, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2009759733485207989_1121, duration: 1916802
2013-10-31 18:33:28,996 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2009759733485207989_1121 size 27802
2013-10-31 18:33:28,997 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2009759733485207989_1121 terminating
2013-10-31 18:33:29,000 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2009759733485207989_1121 size 27802
2013-10-31 18:33:29,000 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml from client DFSClient_-1596270109
2013-10-31 18:33:29,001 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:33:29,005 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml. blk_5001471268516047652_1121
2013-10-31 18:33:29,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml	dst=null	perm=null
2013-10-31 18:33:29,015 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47313, bytes: 28022, op: HDFS_READ, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2009759733485207989_1121, duration: 405352
2013-10-31 18:33:29,035 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0013: nMaps=1 nReduces=1 max=-1
2013-10-31 18:33:29,035 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0013 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:33:29,035 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0013
2013-10-31 18:33:29,035 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0013	RESULT=SUCCESS
2013-10-31 18:33:29,036 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0013
2013-10-31 18:33:29,037 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] submitted hadoop job: job_20131031182606197_0013
2013-10-31 18:33:29,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5001471268516047652_1121 src: /127.0.0.1:49943 dest: /127.0.0.1:34578
2013-10-31 18:33:29,045 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5001471268516047652_1121 src: /127.0.0.1:43141 dest: /127.0.0.1:59471
2013-10-31 18:33:29,046 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5001471268516047652_1121 src: /127.0.0.1:47316 dest: /127.0.0.1:54365
2013-10-31 18:33:29,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47316, dest: /127.0.0.1:54365, bytes: 26964, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5001471268516047652_1121, duration: 1101275
2013-10-31 18:33:29,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5001471268516047652_1121 terminating
2013-10-31 18:33:29,048 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_3668603729858618955_1115 to 127.0.0.1:34578 
2013-10-31 18:33:29,049 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43141, dest: /127.0.0.1:59471, bytes: 26964, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5001471268516047652_1121, duration: 711637
2013-10-31 18:33:29,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5658866385858982902_1108 file build/test/data/dfs/data/data4/current/blk_-5658866385858982902 for deletion
2013-10-31 18:33:29,049 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5001471268516047652_1121 terminating
2013-10-31 18:33:29,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data4/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:29,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1473407138158581377_1107 file build/test/data/dfs/data/data3/current/blk_1473407138158581377 for deletion
2013-10-31 18:33:29,049 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5001471268516047652_1121 size 26964
2013-10-31 18:33:29,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1473407138158581377_1107 at file build/test/data/dfs/data/data3/current/blk_1473407138158581377
2013-10-31 18:33:29,050 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49943, dest: /127.0.0.1:34578, bytes: 26964, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5001471268516047652_1121, duration: 1289409
2013-10-31 18:33:29,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data4/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:29,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5001471268516047652_1121 size 26964
2013-10-31 18:33:29,049 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5658866385858982902_1108 at file build/test/data/dfs/data/data4/current/blk_-5658866385858982902
2013-10-31 18:33:29,052 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml from client DFSClient_-1596270109
2013-10-31 18:33:29,051 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:49946 dest: /127.0.0.1:34578
2013-10-31 18:33:29,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data4/current/blk_-1646609186769667995
2013-10-31 18:33:29,050 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5001471268516047652_1121 terminating
2013-10-31 18:33:29,053 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data4/current/blk_4636075907529433197
2013-10-31 18:33:29,052 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:33:29,052 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_3668603729858618955_1115 to /127.0.0.1:34578
2013-10-31 18:33:29,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3668603729858618955_1115 src: /127.0.0.1:49946 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:33:29,053 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5001471268516047652_1121 size 26964
2013-10-31 18:33:29,056 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:29,778 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7656384865086930476_1111 file build/test/data/dfs/data/data6/current/blk_7656384865086930476 for deletion
2013-10-31 18:33:29,778 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7656384865086930476_1111 at file build/test/data/dfs/data/data6/current/blk_7656384865086930476
2013-10-31 18:33:30,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml	dst=null	perm=null
2013-10-31 18:33:30,053 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49948, bytes: 27176, op: HDFS_READ, cliID: DFSClient_-816942347, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5001471268516047652_1121, duration: 406492
2013-10-31 18:33:30,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,063 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml. blk_5588664725749623445_1123
2013-10-31 18:33:30,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5588664725749623445_1123 src: /127.0.0.1:47320 dest: /127.0.0.1:54365
2013-10-31 18:33:30,066 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5588664725749623445_1123 src: /127.0.0.1:49950 dest: /127.0.0.1:34578
2013-10-31 18:33:30,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5588664725749623445_1123 src: /127.0.0.1:43148 dest: /127.0.0.1:59471
2013-10-31 18:33:30,072 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43148, dest: /127.0.0.1:59471, bytes: 27867, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5588664725749623445_1123, duration: 405874
2013-10-31 18:33:30,073 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5588664725749623445_1123 terminating
2013-10-31 18:33:30,073 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49950, dest: /127.0.0.1:34578, bytes: 27867, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5588664725749623445_1123, duration: 1225208
2013-10-31 18:33:30,074 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5588664725749623445_1123 terminating
2013-10-31 18:33:30,074 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47320, dest: /127.0.0.1:54365, bytes: 27867, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5588664725749623445_1123, duration: 2205951
2013-10-31 18:33:30,075 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5588664725749623445_1123 terminating
2013-10-31 18:33:30,076 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5588664725749623445_1123 size 27867
2013-10-31 18:33:30,077 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml from client DFSClient_-1622110505
2013-10-31 18:33:30,077 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml is closed by DFSClient_-1622110505
2013-10-31 18:33:30,078 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5588664725749623445_1123 size 27867
2013-10-31 18:33:30,079 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5588664725749623445_1123 size 27867
2013-10-31 18:33:30,097 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0012: nMaps=1 nReduces=0 max=-1
2013-10-31 18:33:30,099 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0012 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:33:30,099 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0012
2013-10-31 18:33:30,099 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0012	RESULT=SUCCESS
2013-10-31 18:33:30,099 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0012
2013-10-31 18:33:30,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,102 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken. blk_-5501218942350876546_1124
2013-10-31 18:33:30,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5501218942350876546_1124 src: /127.0.0.1:49952 dest: /127.0.0.1:34578
2013-10-31 18:33:30,106 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5501218942350876546_1124 src: /127.0.0.1:43150 dest: /127.0.0.1:59471
2013-10-31 18:33:30,107 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5501218942350876546_1124 src: /127.0.0.1:47325 dest: /127.0.0.1:54365
2013-10-31 18:33:30,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,112 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47325, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5501218942350876546_1124, duration: 1106070
2013-10-31 18:33:30,113 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5501218942350876546_1124 terminating
2013-10-31 18:33:30,113 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43150, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5501218942350876546_1124, duration: 1857829
2013-10-31 18:33:30,113 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5501218942350876546_1124 terminating
2013-10-31 18:33:30,114 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49952, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5501218942350876546_1124, duration: 2726577
2013-10-31 18:33:30,114 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5501218942350876546_1124 terminating
2013-10-31 18:33:30,116 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] submitted hadoop job: job_20131031182606197_0012
2013-10-31 18:33:30,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5501218942350876546_1124 size 116
2013-10-31 18:33:30,117 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken from client DFSClient_-1596270109
2013-10-31 18:33:30,117 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:33:30,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5501218942350876546_1124 size 116
2013-10-31 18:33:30,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5501218942350876546_1124 size 116
2013-10-31 18:33:30,120 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken
2013-10-31 18:33:30,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:33:30,123 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47326, bytes: 49, op: HDFS_READ, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7462121373986728613_1119, duration: 123660
2013-10-31 18:33:30,123 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0013 = 1697. Number of splits = 1
2013-10-31 18:33:30,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,124 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,125 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0013 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:33:30,125 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0013 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 18:33:30,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,132 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml. blk_7711436382493962850_1126
2013-10-31 18:33:30,133 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7711436382493962850_1126 src: /127.0.0.1:49956 dest: /127.0.0.1:34578
2013-10-31 18:33:30,135 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7711436382493962850_1126 src: /127.0.0.1:43154 dest: /127.0.0.1:59471
2013-10-31 18:33:30,135 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7711436382493962850_1126 src: /127.0.0.1:47046 dest: /127.0.0.1:37740
2013-10-31 18:33:30,138 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47046, dest: /127.0.0.1:37740, bytes: 27029, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7711436382493962850_1126, duration: 589591
2013-10-31 18:33:30,139 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7711436382493962850_1126 terminating
2013-10-31 18:33:30,139 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43154, dest: /127.0.0.1:59471, bytes: 27029, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7711436382493962850_1126, duration: 1234062
2013-10-31 18:33:30,140 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7711436382493962850_1126 terminating
2013-10-31 18:33:30,140 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49956, dest: /127.0.0.1:34578, bytes: 27029, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7711436382493962850_1126, duration: 2163226
2013-10-31 18:33:30,140 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7711436382493962850_1126 terminating
2013-10-31 18:33:30,144 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7711436382493962850_1126 size 27029
2013-10-31 18:33:30,144 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7711436382493962850_1126 size 27029
2013-10-31 18:33:30,145 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7711436382493962850_1126 size 27029
2013-10-31 18:33:30,145 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml from client DFSClient_-816942347
2013-10-31 18:33:30,145 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml is closed by DFSClient_-816942347
2013-10-31 18:33:30,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,154 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken. blk_-5293425425470303312_1127
2013-10-31 18:33:30,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5293425425470303312_1127 src: /127.0.0.1:47047 dest: /127.0.0.1:37740
2013-10-31 18:33:30,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5293425425470303312_1127 src: /127.0.0.1:47331 dest: /127.0.0.1:54365
2013-10-31 18:33:30,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5293425425470303312_1127 src: /127.0.0.1:43158 dest: /127.0.0.1:59471
2013-10-31 18:33:30,163 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43158, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5293425425470303312_1127, duration: 28161
2013-10-31 18:33:30,163 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5293425425470303312_1127 terminating
2013-10-31 18:33:30,164 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5293425425470303312_1127 size 116
2013-10-31 18:33:30,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47331, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5293425425470303312_1127, duration: 1450047
2013-10-31 18:33:30,165 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5293425425470303312_1127 terminating
2013-10-31 18:33:30,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47047, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5293425425470303312_1127, duration: 1866471
2013-10-31 18:33:30,166 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5293425425470303312_1127 terminating
2013-10-31 18:33:30,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5293425425470303312_1127 size 116
2013-10-31 18:33:30,169 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5293425425470303312_1127 size 116
2013-10-31 18:33:30,169 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken from client DFSClient_-1596270109
2013-10-31 18:33:30,169 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:33:30,173 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken
2013-10-31 18:33:30,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:33:30,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47333, bytes: 49, op: HDFS_READ, cliID: DFSClient_-816942347, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2323677095253206755_1119, duration: 122684
2013-10-31 18:33:30,177 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0012 = 1697. Number of splits = 1
2013-10-31 18:33:30,177 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,177 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,177 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,178 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0012 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:33:30,178 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0012 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 18:33:30,211 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-3922365374298370577_1115 to 127.0.0.1:59471 
2013-10-31 18:33:30,212 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-3922365374298370577_1115 to /127.0.0.1:59471
2013-10-31 18:33:30,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:43160 dest: /127.0.0.1:59471
2013-10-31 18:33:30,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3922365374298370577_1115 src: /127.0.0.1:43160 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:33:30,216 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:31,150 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0012_m_000002_0' to tip task_20131031182606197_0012_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:33:31,156 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000003_0'
2013-10-31 18:33:31,158 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0012_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:33:31,158 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0012_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,158 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0012_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken	dst=null	perm=null
2013-10-31 18:33:31,167 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47052, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5293425425470303312_1127, duration: 313318
2013-10-31 18:33:31,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml	dst=null	perm=null
2013-10-31 18:33:31,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43163, bytes: 27176, op: HDFS_READ, cliID: DFSClient_221142571, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5001471268516047652_1121, duration: 445442
2013-10-31 18:33:31,207 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:33:31,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar	dst=null	perm=null
2013-10-31 18:33:31,232 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0013_m_000002_0' to tip task_20131031182606197_0013_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:31,238 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:33:31,239 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,239 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,240 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47338, bytes: 239915, op: HDFS_READ, cliID: DFSClient_221142571, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3668603729858618955_1115, duration: 1455085
2013-10-31 18:33:31,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken	dst=null	perm=null
2013-10-31 18:33:31,247 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49968, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5501218942350876546_1124, duration: 279867
2013-10-31 18:33:31,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml	dst=null	perm=null
2013-10-31 18:33:31,256 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49970, bytes: 28022, op: HDFS_READ, cliID: DFSClient_2097362858, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2009759733485207989_1121, duration: 379586
2013-10-31 18:33:31,282 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:33:31,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar	dst=null	perm=null
2013-10-31 18:33:31,299 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47342, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2097362858, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3922365374298370577_1115, duration: 530683
2013-10-31 18:33:31,307 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0012_m_-357367951
2013-10-31 18:33:31,308 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0012_m_-357367951 spawned.
2013-10-31 18:33:31,309 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0012/attempt_20131031182606197_0012_m_000002_0/taskjvm.sh
2013-10-31 18:33:31,384 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0011_m_-575970400
2013-10-31 18:33:31,391 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22844 with signal TERM. Exit code 0
2013-10-31 18:33:31,391 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0013_m_932760728
2013-10-31 18:33:31,392 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0013_m_932760728 spawned.
2013-10-31 18:33:31,393 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0013/attempt_20131031182606197_0013_m_000002_0/taskjvm.sh
2013-10-31 18:33:31,413 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_7656384865086930476_1111 blk_1473407138158581377_1107 blk_4636075907529433197_1106 blk_-5658866385858982902_1108 blk_-1646609186769667995_1105
2013-10-31 18:33:31,413 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_7656384865086930476_1111
2013-10-31 18:33:31,472 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:31,473 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:31,473 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:31,473 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_-575970400 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:33:33,176 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5658866385858982902_1108 file build/test/data/dfs/data/data1/current/blk_-5658866385858982902 for deletion
2013-10-31 18:33:33,177 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data2/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:33,177 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5658866385858982902_1108 at file build/test/data/dfs/data/data1/current/blk_-5658866385858982902
2013-10-31 18:33:33,177 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1473407138158581377_1107 file build/test/data/dfs/data/data2/current/blk_1473407138158581377 for deletion
2013-10-31 18:33:33,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data2/current/blk_-1646609186769667995
2013-10-31 18:33:33,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data1/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:33,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1473407138158581377_1107 at file build/test/data/dfs/data/data2/current/blk_1473407138158581377
2013-10-31 18:33:33,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data1/current/blk_4636075907529433197
2013-10-31 18:33:33,178 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7656384865086930476_1111 file build/test/data/dfs/data/data1/current/blk_7656384865086930476 for deletion
2013-10-31 18:33:33,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7656384865086930476_1111 at file build/test/data/dfs/data/data1/current/blk_7656384865086930476
2013-10-31 18:33:33,227 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:33,227 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0011_m_000004_0 not found in cache
2013-10-31 18:33:33,228 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330813228
2013-10-31 18:33:33,249 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7656384865086930476_1111 file build/test/data/dfs/data/data8/current/blk_7656384865086930476 for deletion
2013-10-31 18:33:33,249 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7656384865086930476_1111 at file build/test/data/dfs/data/data8/current/blk_7656384865086930476
2013-10-31 18:33:33,263 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:33,263 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:33,264 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330813264
2013-10-31 18:33:33,264 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330813264
2013-10-31 18:33:33,306 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_r_1328977401 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,317 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23235 with signal TERM. Exit code 0
2013-10-31 18:33:33,501 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_1263282871 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,503 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:33,503 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:33,503 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:33,503 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_r_1328977401 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:33,512 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23374 with signal TERM. Exit code 0
2013-10-31 18:33:33,682 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:33,683 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:33,683 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:33,683 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_1263282871 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:33,945 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_-538677001 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,957 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23068 with signal TERM. Exit code 0
2013-10-31 18:33:33,977 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_1012864139 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,986 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23098 with signal TERM. Exit code 0
2013-10-31 18:33:34,190 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:34,190 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:34,191 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:34,191 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_1012864139 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:34,197 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:34,197 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:34,197 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:34,197 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_-538677001 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:35,669 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0012_m_-357367951 given task: attempt_20131031182606197_0012_m_000002_0
2013-10-31 18:33:36,158 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:36,159 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330816159
2013-10-31 18:33:37,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:37,344 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_116991220 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:37,353 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23191 with signal TERM. Exit code 0
2013-10-31 18:33:37,544 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:37,544 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:37,544 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:37,545 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_116991220 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:37,669 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_m_932760728 given task: attempt_20131031182606197_0013_m_000002_0
2013-10-31 18:33:38,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:40,150 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000002_0 0.0% setup
2013-10-31 18:33:40,153 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0012_m_000002_0 is done.
2013-10-31 18:33:40,153 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0012_m_000002_0  was -1
2013-10-31 18:33:40,153 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:40,164 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0012_m_000002_0' has completed task_20131031182606197_0012_m_000002 successfully.
2013-10-31 18:33:40,166 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0012_m_000000_0' to tip task_20131031182606197_0012_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:33:40,166 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0012_m_000000
2013-10-31 18:33:40,167 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0012_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:40,167 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0012_m_000000_0 which needs 1 slots
2013-10-31 18:33:40,168 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0012_m_000000_0 which needs 1 slots
2013-10-31 18:33:40,230 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0012_m_18846988
2013-10-31 18:33:40,231 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0012_m_18846988 spawned.
2013-10-31 18:33:40,234 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0012/attempt_20131031182606197_0012_m_000000_0/taskjvm.sh
2013-10-31 18:33:41,067 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0012_m_18846988 given task: attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:41,138 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000002_0 0.0% setup
2013-10-31 18:33:41,140 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_m_000002_0 is done.
2013-10-31 18:33:41,140 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_m_000002_0  was -1
2013-10-31 18:33:41,140 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:41,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split	dst=null	perm=null
2013-10-31 18:33:41,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49981, bytes: 358, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_382693967759542507_1117, duration: 132820
2013-10-31 18:33:41,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000	dst=null	perm=null
2013-10-31 18:33:41,630 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49982, bytes: 1713, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1328316139791502870_1112, duration: 367555
2013-10-31 18:33:41,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:41,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:41,905 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000. blk_7101250285511173582_1128
2013-10-31 18:33:41,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7101250285511173582_1128 src: /127.0.0.1:47354 dest: /127.0.0.1:54365
2013-10-31 18:33:41,938 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7101250285511173582_1128 src: /127.0.0.1:43181 dest: /127.0.0.1:59471
2013-10-31 18:33:41,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7101250285511173582_1128 src: /127.0.0.1:49985 dest: /127.0.0.1:34578
2013-10-31 18:33:41,943 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49985, dest: /127.0.0.1:34578, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7101250285511173582_1128, duration: 1699605
2013-10-31 18:33:41,943 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7101250285511173582_1128 terminating
2013-10-31 18:33:41,944 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43181, dest: /127.0.0.1:59471, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7101250285511173582_1128, duration: 1738076
2013-10-31 18:33:41,944 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7101250285511173582_1128 terminating
2013-10-31 18:33:41,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47354, dest: /127.0.0.1:54365, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7101250285511173582_1128, duration: 2633154
2013-10-31 18:33:41,945 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7101250285511173582_1128 terminating
2013-10-31 18:33:41,946 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7101250285511173582_1128 size 1490
2013-10-31 18:33:41,947 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7101250285511173582_1128 size 1490
2013-10-31 18:33:41,947 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:41,947 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:41,948 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7101250285511173582_1128 size 1490
2013-10-31 18:33:42,010 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0012_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:33:42,010 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000000_0 0.0% 
2013-10-31 18:33:43,171 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:43,250 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_m_000002_0' has completed task_20131031182606197_0013_m_000002 successfully.
2013-10-31 18:33:43,253 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0013_m_000000_0' to tip task_20131031182606197_0013_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:43,254 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0013_m_000000
2013-10-31 18:33:43,256 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:43,256 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_m_000000_0 which needs 1 slots
2013-10-31 18:33:43,256 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_m_000000_0 which needs 1 slots
2013-10-31 18:33:43,288 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0013_m_-137784207
2013-10-31 18:33:43,289 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0013_m_-137784207 spawned.
2013-10-31 18:33:43,291 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0013/attempt_20131031182606197_0013_m_000000_0/taskjvm.sh
2013-10-31 18:33:44,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0	dst=null	perm=null
2013-10-31 18:33:44,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:44,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:44,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0	dst=null	perm=null
2013-10-31 18:33:44,150 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_m_-137784207 given task: attempt_20131031182606197_0013_m_000000_0
2013-10-31 18:33:44,497 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000:0+1697
2013-10-31 18:33:44,498 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0012_m_000000_0 is done.
2013-10-31 18:33:44,498 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0012_m_000000_0  was -1
2013-10-31 18:33:44,499 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:44,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split	dst=null	perm=null
2013-10-31 18:33:44,641 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47077, bytes: 358, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0013_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2114727610416078497_1117, duration: 149868
2013-10-31 18:33:44,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000	dst=null	perm=null
2013-10-31 18:33:44,677 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47361, bytes: 1713, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0013_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1328316139791502870_1112, duration: 145169
2013-10-31 18:33:45,168 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0012_m_000002_0
2013-10-31 18:33:45,168 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0012_m_000002_0
2013-10-31 18:33:45,168 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0012_m_000002_0 not found in cache
2013-10-31 18:33:46,174 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0012_m_000000_0' has completed task_20131031182606197_0012_m_000000 successfully.
2013-10-31 18:33:46,178 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0012_m_000001_0' to tip task_20131031182606197_0012_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:33:46,180 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0012_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:33:46,181 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0012_m_000001_0 which needs 1 slots
2013-10-31 18:33:46,181 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0012_m_000001_0 which needs 1 slots
2013-10-31 18:33:46,210 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0012/attempt_20131031182606197_0012_m_000001_0. Attempting to reuse: jvm_20131031182606197_0012_m_18846988
2013-10-31 18:33:46,550 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0012_m_18846988 given task: attempt_20131031182606197_0012_m_000001_0
2013-10-31 18:33:46,668 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000001_0 0.0% 
2013-10-31 18:33:46,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary	dst=null	perm=null
2013-10-31 18:33:46,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:46,708 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_SUCCESS from client DFSClient_attempt_20131031182606197_0012_m_000001_0
2013-10-31 18:33:46,709 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0012_m_000001_0
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:46,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2323677095253206755 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,714 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2323677095253206755 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:46,714 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2323677095253206755 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,714 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5001471268516047652 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:46,714 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5001471268516047652 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,714 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5001471268516047652 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012	dst=null	perm=null
2013-10-31 18:33:47,572 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000:0+1697
2013-10-31 18:33:47,575 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_m_000000_0 is done.
2013-10-31 18:33:47,576 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_m_000000_0  was 1593
2013-10-31 18:33:47,576 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:48,256 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0013_m_000002_0
2013-10-31 18:33:48,256 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0013_m_000002_0
2013-10-31 18:33:48,257 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0013_m_000002_0 not found in cache
2013-10-31 18:33:49,262 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_m_000000_0' has completed task_20131031182606197_0013_m_000000 successfully.
2013-10-31 18:33:49,264 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0013_r_000000_0' to tip task_20131031182606197_0013_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:49,266 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:49,266 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_r_000000_0 which needs 1 slots
2013-10-31 18:33:49,267 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_r_000000_0 which needs 1 slots
2013-10-31 18:33:49,304 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0013_r_-2042360792
2013-10-31 18:33:49,304 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0013_r_-2042360792 spawned.
2013-10-31 18:33:49,306 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0013/attempt_20131031182606197_0013_r_000000_0/taskjvm.sh
2013-10-31 18:33:49,417 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5001471268516047652_1121 blk_382693967759542507_1117 blk_3668603729858618955_1115 blk_-2323677095253206755_1119
2013-10-31 18:33:49,417 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_382693967759542507_1117 blk_3668603729858618955_1115 blk_-2323677095253206755_1119
2013-10-31 18:33:49,639 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000001_0 0.0% cleanup
2013-10-31 18:33:49,640 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0012_m_000001_0 is done.
2013-10-31 18:33:49,640 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0012_m_000001_0  was -1
2013-10-31 18:33:49,640 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:50,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2323677095253206755_1119 file build/test/data/dfs/data/data4/current/blk_-2323677095253206755 for deletion
2013-10-31 18:33:50,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2323677095253206755_1119 at file build/test/data/dfs/data/data4/current/blk_-2323677095253206755
2013-10-31 18:33:50,056 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data4/current/blk_382693967759542507 for deletion
2013-10-31 18:33:50,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data4/current/blk_382693967759542507
2013-10-31 18:33:50,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data4/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:50,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5001471268516047652_1121 file build/test/data/dfs/data/data4/current/blk_5001471268516047652 for deletion
2013-10-31 18:33:50,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data4/current/blk_3668603729858618955
2013-10-31 18:33:50,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5001471268516047652_1121 at file build/test/data/dfs/data/data4/current/blk_5001471268516047652
2013-10-31 18:33:50,150 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_r_-2042360792 given task: attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:51,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2323677095253206755_1119 file build/test/data/dfs/data/data8/current/blk_-2323677095253206755 for deletion
2013-10-31 18:33:51,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data7/current/blk_382693967759542507 for deletion
2013-10-31 18:33:51,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2323677095253206755_1119 at file build/test/data/dfs/data/data8/current/blk_-2323677095253206755
2013-10-31 18:33:51,256 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data7/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:51,256 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data7/current/blk_382693967759542507
2013-10-31 18:33:51,256 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data7/current/blk_3668603729858618955
2013-10-31 18:33:52,188 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0012_m_000001_0' has completed task_20131031182606197_0012_m_000001 successfully.
2013-10-31 18:33:52,189 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0012 has completed successfully.
2013-10-31 18:33:52,191 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0012,submitTime=1383244410043,launchTime=1383244410178,firstMapTaskLaunchTime=1383244420166,firstJobSetupTaskLaunchTime=1383244411150,firstJobCleanupTaskLaunchTime=1383244426177,finishTime=1383244432189,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=16,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7906116797DA4A08896623D5F776AFB9/A025C715160B43E7B09224193417545A] output1+output2/(2/3) ...edpipesplatform/splitout1
2013-10-31 18:33:52,196 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7. blk_2600348140943850569_1129
2013-10-31 18:33:52,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2600348140943850569_1129 src: /127.0.0.1:47366 dest: /127.0.0.1:54365
2013-10-31 18:33:52,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2600348140943850569_1129 src: /127.0.0.1:47084 dest: /127.0.0.1:37740
2013-10-31 18:33:52,202 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2600348140943850569_1129 src: /127.0.0.1:43194 dest: /127.0.0.1:59471
2013-10-31 18:33:52,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43194, dest: /127.0.0.1:59471, bytes: 11380, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2600348140943850569_1129, duration: 5659993
2013-10-31 18:33:52,212 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2600348140943850569_1129 terminating
2013-10-31 18:33:52,212 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2600348140943850569_1129 size 11380
2013-10-31 18:33:52,212 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47084, dest: /127.0.0.1:37740, bytes: 11380, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2600348140943850569_1129, duration: 4546318
2013-10-31 18:33:52,213 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2600348140943850569_1129 terminating
2013-10-31 18:33:52,213 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47366, dest: /127.0.0.1:54365, bytes: 11380, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2600348140943850569_1129, duration: 4233243
2013-10-31 18:33:52,214 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2600348140943850569_1129 terminating
2013-10-31 18:33:52,217 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2600348140943850569_1129 size 11380
2013-10-31 18:33:52,218 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 from client DFSClient_-816942347
2013-10-31 18:33:52,219 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 is closed by DFSClient_-816942347
2013-10-31 18:33:52,219 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2600348140943850569_1129 size 11380
2013-10-31 18:33:52,225 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:52,226 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0012_m_000000_0'
2013-10-31 18:33:52,226 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0012_m_000001_0'
2013-10-31 18:33:52,226 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0012_m_000002_0'
2013-10-31 18:33:52,227 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5293425425470303312 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:52,227 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5293425425470303312 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:52,228 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5293425425470303312 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:52,231 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0012_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:52,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012	dst=null	perm=null
2013-10-31 18:33:52,269 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:52,269 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0012 being deleted.
2013-10-31 18:33:52,287 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:52,287 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0012 being deleted.
2013-10-31 18:33:52,288 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:52,288 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0012 being deleted.
2013-10-31 18:33:52,418 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_5001471268516047652_1121 blk_382693967759542507_1117 blk_3668603729858618955_1115 blk_-2323677095253206755_1119
2013-10-31 18:33:52,418 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5001471268516047652_1121 blk_-5293425425470303312_1127 blk_382693967759542507_1117 blk_3668603729858618955_1115
2013-10-31 18:33:53,786 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5293425425470303312_1127 file build/test/data/dfs/data/data5/current/blk_-5293425425470303312 for deletion
2013-10-31 18:33:53,787 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data6/current/blk_382693967759542507 for deletion
2013-10-31 18:33:53,787 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5293425425470303312_1127 at file build/test/data/dfs/data/data5/current/blk_-5293425425470303312
2013-10-31 18:33:53,787 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data6/current/blk_382693967759542507
2013-10-31 18:33:53,787 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data6/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:53,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5001471268516047652_1121 file build/test/data/dfs/data/data5/current/blk_5001471268516047652 for deletion
2013-10-31 18:33:53,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data6/current/blk_3668603729858618955
2013-10-31 18:33:53,788 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5001471268516047652_1121 at file build/test/data/dfs/data/data5/current/blk_5001471268516047652
2013-10-31 18:33:54,183 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2323677095253206755_1119 file build/test/data/dfs/data/data2/current/blk_-2323677095253206755 for deletion
2013-10-31 18:33:54,183 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data2/current/blk_382693967759542507 for deletion
2013-10-31 18:33:54,183 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2323677095253206755_1119 at file build/test/data/dfs/data/data2/current/blk_-2323677095253206755
2013-10-31 18:33:54,184 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data1/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:54,184 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data2/current/blk_382693967759542507
2013-10-31 18:33:54,184 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5001471268516047652_1121 file build/test/data/dfs/data/data2/current/blk_5001471268516047652 for deletion
2013-10-31 18:33:54,184 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data1/current/blk_3668603729858618955
2013-10-31 18:33:54,184 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5001471268516047652_1121 at file build/test/data/dfs/data/data2/current/blk_5001471268516047652
2013-10-31 18:33:55,419 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-5293425425470303312_1127
2013-10-31 18:33:55,419 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-5293425425470303312_1127
2013-10-31 18:33:55,812 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49036, bytes: 1593, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0013_m_000000_0, duration: 7790027
2013-10-31 18:33:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:33:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,037 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,042 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,048 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,048 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:33:56,057 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5293425425470303312_1127 file build/test/data/dfs/data/data3/current/blk_-5293425425470303312 for deletion
2013-10-31 18:33:56,058 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5293425425470303312_1127 at file build/test/data/dfs/data/data3/current/blk_-5293425425470303312
2013-10-31 18:33:56,628 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:56,673 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:56,731 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:56,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:56,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:56,943 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000. blk_-5006662988950646824_1130
2013-10-31 18:33:56,965 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5006662988950646824_1130 src: /127.0.0.1:43198 dest: /127.0.0.1:59471
2013-10-31 18:33:56,967 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5006662988950646824_1130 src: /127.0.0.1:47373 dest: /127.0.0.1:54365
2013-10-31 18:33:56,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5006662988950646824_1130 src: /127.0.0.1:50003 dest: /127.0.0.1:34578
2013-10-31 18:33:56,970 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50003, dest: /127.0.0.1:34578, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0013_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5006662988950646824_1130, duration: 1191607
2013-10-31 18:33:56,970 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5006662988950646824_1130 terminating
2013-10-31 18:33:56,970 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47373, dest: /127.0.0.1:54365, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0013_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5006662988950646824_1130, duration: 1546070
2013-10-31 18:33:56,970 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5006662988950646824_1130 terminating
2013-10-31 18:33:56,971 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43198, dest: /127.0.0.1:59471, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0013_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5006662988950646824_1130, duration: 1847252
2013-10-31 18:33:56,971 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5006662988950646824_1130 terminating
2013-10-31 18:33:56,972 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5006662988950646824_1130 size 1490
2013-10-31 18:33:56,974 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5006662988950646824_1130 size 1490
2013-10-31 18:33:56,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5006662988950646824_1130 size 1490
2013-10-31 18:33:56,975 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:56,976 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:57,021 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0013_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:33:57,021 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:57,228 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:57,228 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0012_m_000000_0 not found in cache
2013-10-31 18:33:57,228 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0012_m_000001_0 not found in cache
2013-10-31 18:33:57,229 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383330837229
2013-10-31 18:33:57,257 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5293425425470303312_1127 file build/test/data/dfs/data/data8/current/blk_-5293425425470303312 for deletion
2013-10-31 18:33:57,257 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5293425425470303312_1127 at file build/test/data/dfs/data/data8/current/blk_-5293425425470303312
2013-10-31 18:33:57,279 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0012_m_-357367951 since job job_20131031182606197_0012 is dead
2013-10-31 18:33:57,289 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23669 with signal TERM. Exit code 0
2013-10-31 18:33:57,457 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:57,457 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:57,457 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:57,458 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0012_m_-357367951 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:57,669 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0012_m_18846988 since job job_20131031182606197_0012 is dead
2013-10-31 18:33:57,679 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23799 with signal TERM. Exit code 0
2013-10-31 18:33:57,854 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:57,854 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:57,854 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:33:57,854 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0012_m_18846988 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:33:58,276 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0013_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:33:58,277 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:59,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0	dst=null	perm=null
2013-10-31 18:33:59,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:59,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:59,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0	dst=null	perm=null
2013-10-31 18:33:59,680 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:59,683 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:59,683 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_r_000000_0 is done.
2013-10-31 18:33:59,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_r_000000_0  was -1
2013-10-31 18:33:59,684 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:01,278 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_r_000000_0' has completed task_20131031182606197_0013_r_000000 successfully.
2013-10-31 18:34:01,282 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0013_m_000001_0' to tip task_20131031182606197_0013_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:01,284 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:01,284 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_m_000001_0 which needs 1 slots
2013-10-31 18:34:01,284 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_m_000001_0 which needs 1 slots
2013-10-31 18:34:01,303 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0013/attempt_20131031182606197_0013_m_000001_0. Attempting to reuse: jvm_20131031182606197_0013_m_932760728
2013-10-31 18:34:02,700 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_m_932760728 given task: attempt_20131031182606197_0013_m_000001_0
2013-10-31 18:34:02,807 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000001_0 0.0% 
2013-10-31 18:34:02,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary	dst=null	perm=null
2013-10-31 18:34:02,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:02,833 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_SUCCESS from client DFSClient_attempt_20131031182606197_0013_m_000001_0
2013-10-31 18:34:02,833 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0013_m_000001_0
2013-10-31 18:34:02,843 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,843 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:02,843 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,843 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:02,844 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:02,844 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,844 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,844 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:02,845 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7462121373986728613 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,845 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7462121373986728613 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,845 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7462121373986728613 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:02,845 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2009759733485207989 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,845 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2009759733485207989 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,846 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2009759733485207989 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:03,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013	dst=null	perm=null
2013-10-31 18:34:04,420 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-2009759733485207989_1121 blk_2114727610416078497_1117 blk_7462121373986728613_1119 blk_-3922365374298370577_1115
2013-10-31 18:34:04,421 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-2009759733485207989_1121 blk_2114727610416078497_1117 blk_7462121373986728613_1119 blk_-3922365374298370577_1115
2013-10-31 18:34:05,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data3/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:05,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2009759733485207989_1121 file build/test/data/dfs/data/data3/current/blk_-2009759733485207989 for deletion
2013-10-31 18:34:05,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data3/current/blk_-3922365374298370577
2013-10-31 18:34:05,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data3/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:05,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2009759733485207989_1121 at file build/test/data/dfs/data/data3/current/blk_-2009759733485207989
2013-10-31 18:34:05,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7462121373986728613_1119 file build/test/data/dfs/data/data3/current/blk_7462121373986728613 for deletion
2013-10-31 18:34:05,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data3/current/blk_2114727610416078497
2013-10-31 18:34:05,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7462121373986728613_1119 at file build/test/data/dfs/data/data3/current/blk_7462121373986728613
2013-10-31 18:34:05,778 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000001_0 0.0% cleanup
2013-10-31 18:34:05,779 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_m_000001_0 is done.
2013-10-31 18:34:05,780 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_m_000001_0  was -1
2013-10-31 18:34:05,780 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:05,790 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data6/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:05,790 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2009759733485207989_1121 file build/test/data/dfs/data/data6/current/blk_-2009759733485207989 for deletion
2013-10-31 18:34:05,790 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data6/current/blk_-3922365374298370577
2013-10-31 18:34:05,791 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data5/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:05,791 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2009759733485207989_1121 at file build/test/data/dfs/data/data6/current/blk_-2009759733485207989
2013-10-31 18:34:05,791 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7462121373986728613_1119 file build/test/data/dfs/data/data5/current/blk_7462121373986728613 for deletion
2013-10-31 18:34:05,791 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data5/current/blk_2114727610416078497
2013-10-31 18:34:05,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7462121373986728613_1119 at file build/test/data/dfs/data/data5/current/blk_7462121373986728613
2013-10-31 18:34:06,285 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:34:06,285 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:34:07,292 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_m_000001_0' has completed task_20131031182606197_0013_m_000001 successfully.
2013-10-31 18:34:07,293 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0013 has completed successfully.
2013-10-31 18:34:07,293 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0013,submitTime=1383244409006,launchTime=1383244410125,firstMapTaskLaunchTime=1383244423252,firstReduceTaskLaunchTime=1383244429263,firstJobSetupTaskLaunchTime=1383244411232,firstJobCleanupTaskLaunchTime=1383244441282,finishTime=1383244447293,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=18,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7906116797DA4A08896623D5F776AFB9/6EDCDC7890834C05829A183414FFE105] output1+output2/(3/3) ...edpipesplatform/splitout2
2013-10-31 18:34:07,301 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05. blk_-2235659000156106976_1131
2013-10-31 18:34:07,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2235659000156106976_1131 src: /127.0.0.1:50006 dest: /127.0.0.1:34578
2013-10-31 18:34:07,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2235659000156106976_1131 src: /127.0.0.1:47379 dest: /127.0.0.1:54365
2013-10-31 18:34:07,307 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2235659000156106976_1131 src: /127.0.0.1:47097 dest: /127.0.0.1:37740
2013-10-31 18:34:07,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47097, dest: /127.0.0.1:37740, bytes: 16994, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2235659000156106976_1131, duration: 1114285
2013-10-31 18:34:07,315 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2235659000156106976_1131 terminating
2013-10-31 18:34:07,315 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47379, dest: /127.0.0.1:54365, bytes: 16994, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2235659000156106976_1131, duration: 5270222
2013-10-31 18:34:07,317 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2235659000156106976_1131 terminating
2013-10-31 18:34:07,317 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50006, dest: /127.0.0.1:34578, bytes: 16994, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2235659000156106976_1131, duration: 7208215
2013-10-31 18:34:07,317 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2235659000156106976_1131 size 16994
2013-10-31 18:34:07,318 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2235659000156106976_1131 terminating
2013-10-31 18:34:07,321 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2235659000156106976_1131 size 16994
2013-10-31 18:34:07,322 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 from client DFSClient_-1622110505
2013-10-31 18:34:07,323 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 is closed by DFSClient_-1622110505
2013-10-31 18:34:07,323 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2235659000156106976_1131 size 16994
2013-10-31 18:34:07,329 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:07,330 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_m_000000_0'
2013-10-31 18:34:07,330 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_m_000001_0'
2013-10-31 18:34:07,331 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_m_000002_0'
2013-10-31 18:34:07,332 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_r_000000_0'
2013-10-31 18:34:07,332 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5501218942350876546 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,332 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5501218942350876546 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,332 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5501218942350876546 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:07,333 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:07,333 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:07,333 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0013 being deleted.
2013-10-31 18:34:07,333 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0013 being deleted.
2013-10-31 18:34:07,335 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0013_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:07,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013	dst=null	perm=null
2013-10-31 18:34:07,342 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_548298036330803898 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,342 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_548298036330803898 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,342 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_548298036330803898 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:07,343 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3041080366967563833 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:07,343 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3041080366967563833 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,343 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3041080366967563833 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,343 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1328316139791502870 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,343 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1328316139791502870 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,344 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1328316139791502870 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:07,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE	dst=null	perm=null
2013-10-31 18:34:07,350 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary
2013-10-31 18:34:07,352 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary
2013-10-31 18:34:07,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1	dst=null	perm=null
2013-10-31 18:34:07,372 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000	dst=null	perm=null
2013-10-31 18:34:07,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000	dst=null	perm=null
2013-10-31 18:34:07,380 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50011, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7101250285511173582_1128, duration: 1693917
2013-10-31 18:34:07,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2	dst=null	perm=null
2013-10-31 18:34:07,399 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000	dst=null	perm=null
2013-10-31 18:34:07,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000	dst=null	perm=null
2013-10-31 18:34:07,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43209, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5006662988950646824_1130, duration: 192870
2013-10-31 18:34:07,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1	dst=null	perm=null
2013-10-31 18:34:07,409 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000	dst=null	perm=null
2013-10-31 18:34:07,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000	dst=null	perm=null
2013-10-31 18:34:07,411 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43210, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7101250285511173582_1128, duration: 172337
2013-10-31 18:34:07,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2	dst=null	perm=null
2013-10-31 18:34:07,419 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,427 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_548298036330803898_1113 blk_-5501218942350876546_1124 blk_-2009759733485207989_1121 blk_2114727610416078497_1117 blk_7462121373986728613_1119 blk_1328316139791502870_1112 blk_-3922365374298370577_1115 blk_-3041080366967563833_1110
2013-10-31 18:34:07,427 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_548298036330803898_1113 blk_2114727610416078497_1117 blk_-3922365374298370577_1115
2013-10-31 18:34:07,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000	dst=null	perm=null
2013-10-31 18:34:07,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000	dst=null	perm=null
2013-10-31 18:34:07,432 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50014, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5006662988950646824_1130, duration: 414477
2013-10-31 18:34:07,432 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitout2
2013-10-31 18:34:07,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2	dst=null	perm=null
2013-10-31 18:34:07,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000	dst=null	perm=null
2013-10-31 18:34:07,438 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitout1
2013-10-31 18:34:07,438 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47386, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5006662988950646824_1130, duration: 411439
2013-10-31 18:34:07,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1	dst=null	perm=null
2013-10-31 18:34:07,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000	dst=null	perm=null
2013-10-31 18:34:07,446 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43213, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7101250285511173582_1128, duration: 399468
2013-10-31 18:34:07,467 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:34:07,468 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:34:07,490 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting
2013-10-31 18:34:07,490 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:34:07,491 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1"]
2013-10-31 18:34:07,491 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2"]
2013-10-31 18:34:07,491 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  parallel execution is enabled: true
2013-10-31 18:34:07,491 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  starting jobs: 2
2013-10-31 18:34:07,491 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  allocating threads: 2
2013-10-31 18:34:07,493 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (1/2) ...eldedpipesplatform/split2
2013-10-31 18:34:07,493 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (2/2) ...eldedpipesplatform/split1
2013-10-31 18:34:07,497 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:07,497 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:34:07,498 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:07,498 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:34:07,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:07,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:34:07,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:07,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:34:07,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,526 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar. blk_6248130088879987270_1132
2013-10-31 18:34:07,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:47105 dest: /127.0.0.1:37740
2013-10-31 18:34:07,530 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:50018 dest: /127.0.0.1:34578
2013-10-31 18:34:07,531 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:43216 dest: /127.0.0.1:59471
2013-10-31 18:34:07,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,540 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar. blk_5720203401911213791_1133
2013-10-31 18:34:07,544 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:50020 dest: /127.0.0.1:34578
2013-10-31 18:34:07,545 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43216, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6248130088879987270_1132, duration: 10183152
2013-10-31 18:34:07,546 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6248130088879987270_1132 terminating
2013-10-31 18:34:07,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:47392 dest: /127.0.0.1:54365
2013-10-31 18:34:07,546 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50018, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6248130088879987270_1132, duration: 11695873
2013-10-31 18:34:07,547 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6248130088879987270_1132 terminating
2013-10-31 18:34:07,547 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47105, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6248130088879987270_1132, duration: 12353445
2013-10-31 18:34:07,548 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6248130088879987270_1132 terminating
2013-10-31 18:34:07,548 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:07,552 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:07,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:43219 dest: /127.0.0.1:59471
2013-10-31 18:34:07,552 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:07,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:07,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:07,558 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar. New replication is 10
2013-10-31 18:34:07,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar	dst=null	perm=null
2013-10-31 18:34:07,564 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43219, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5720203401911213791_1133, duration: 8231419
2013-10-31 18:34:07,565 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5720203401911213791_1133 terminating
2013-10-31 18:34:07,567 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47392, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5720203401911213791_1133, duration: 9595622
2013-10-31 18:34:07,567 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5720203401911213791_1133 terminating
2013-10-31 18:34:07,567 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:07,567 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50020, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5720203401911213791_1133, duration: 11951688
2013-10-31 18:34:07,568 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5720203401911213791_1133 terminating
2013-10-31 18:34:07,571 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:07,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,572 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:07,572 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:07,572 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:07,573 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:07,578 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar. New replication is 10
2013-10-31 18:34:07,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar	dst=null	perm=null
2013-10-31 18:34:07,583 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,588 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:07,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:07,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,596 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:07,603 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split. New replication is 10
2013-10-31 18:34:07,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=null
2013-10-31 18:34:07,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,616 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split. blk_-6443718356478161979_1135
2013-10-31 18:34:07,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:47394 dest: /127.0.0.1:54365
2013-10-31 18:34:07,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:50024 dest: /127.0.0.1:34578
2013-10-31 18:34:07,623 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:47113 dest: /127.0.0.1:37740
2013-10-31 18:34:07,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:43223 dest: /127.0.0.1:59471
2013-10-31 18:34:07,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,627 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split. New replication is 10
2013-10-31 18:34:07,628 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43223, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6443718356478161979_1135, duration: 103663
2013-10-31 18:34:07,628 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,629 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,629 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47113, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6443718356478161979_1135, duration: 1043053
2013-10-31 18:34:07,629 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,630 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50024, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6443718356478161979_1135, duration: 2055081
2013-10-31 18:34:07,630 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47394, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6443718356478161979_1135, duration: 3086975
2013-10-31 18:34:07,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=null
2013-10-31 18:34:07,634 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,635 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split from client DFSClient_-1596270109
2013-10-31 18:34:07,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:07,635 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,636 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,640 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split. blk_6521390248325677253_1135
2013-10-31 18:34:07,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:50027 dest: /127.0.0.1:34578
2013-10-31 18:34:07,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:43225 dest: /127.0.0.1:59471
2013-10-31 18:34:07,645 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:47117 dest: /127.0.0.1:37740
2013-10-31 18:34:07,647 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:47401 dest: /127.0.0.1:54365
2013-10-31 18:34:07,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47401, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6521390248325677253_1135, duration: 89565
2013-10-31 18:34:07,651 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,651 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47117, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6521390248325677253_1135, duration: 972070
2013-10-31 18:34:07,652 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,652 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43225, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6521390248325677253_1135, duration: 1928815
2013-10-31 18:34:07,653 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,653 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50027, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6521390248325677253_1135, duration: 2776152
2013-10-31 18:34:07,653 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,654 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,655 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,656 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,656 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,679 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split from client DFSClient_-1596270109
2013-10-31 18:34:07,679 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:08,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,276 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo. blk_6337612719236416595_1137
2013-10-31 18:34:08,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6337612719236416595_1137 src: /127.0.0.1:50031 dest: /127.0.0.1:34578
2013-10-31 18:34:08,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6337612719236416595_1137 src: /127.0.0.1:47120 dest: /127.0.0.1:37740
2013-10-31 18:34:08,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6337612719236416595_1137 src: /127.0.0.1:47404 dest: /127.0.0.1:54365
2013-10-31 18:34:08,284 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47404, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6337612719236416595_1137, duration: 65702
2013-10-31 18:34:08,284 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6337612719236416595_1137 terminating
2013-10-31 18:34:08,285 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47120, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6337612719236416595_1137, duration: 844033
2013-10-31 18:34:08,285 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6337612719236416595_1137 terminating
2013-10-31 18:34:08,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50031, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6337612719236416595_1137, duration: 1931460
2013-10-31 18:34:08,287 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6337612719236416595_1137 terminating
2013-10-31 18:34:08,289 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6337612719236416595_1137 size 156
2013-10-31 18:34:08,291 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6337612719236416595_1137 size 156
2013-10-31 18:34:08,292 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6337612719236416595_1137 size 156
2013-10-31 18:34:08,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,328 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo. blk_6288635088291707302_1137
2013-10-31 18:34:08,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6288635088291707302_1137 src: /127.0.0.1:50034 dest: /127.0.0.1:34578
2013-10-31 18:34:08,331 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6288635088291707302_1137 src: /127.0.0.1:47123 dest: /127.0.0.1:37740
2013-10-31 18:34:08,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6288635088291707302_1137 src: /127.0.0.1:43233 dest: /127.0.0.1:59471
2013-10-31 18:34:08,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43233, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6288635088291707302_1137, duration: 68194
2013-10-31 18:34:08,336 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6288635088291707302_1137 terminating
2013-10-31 18:34:08,336 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6288635088291707302_1137 size 156
2013-10-31 18:34:08,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47123, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6288635088291707302_1137, duration: 876292
2013-10-31 18:34:08,337 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6288635088291707302_1137 terminating
2013-10-31 18:34:08,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50034, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6288635088291707302_1137, duration: 1801239
2013-10-31 18:34:08,338 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6288635088291707302_1137 terminating
2013-10-31 18:34:08,341 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:08,342 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:08,342 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6288635088291707302_1137 size 156
2013-10-31 18:34:08,343 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6288635088291707302_1137 size 156
2013-10-31 18:34:08,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,365 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml. blk_-7471099473439155231_1138
2013-10-31 18:34:08,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7471099473439155231_1138 src: /127.0.0.1:43234 dest: /127.0.0.1:59471
2013-10-31 18:34:08,368 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7471099473439155231_1138 src: /127.0.0.1:47126 dest: /127.0.0.1:37740
2013-10-31 18:34:08,370 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7471099473439155231_1138 src: /127.0.0.1:47410 dest: /127.0.0.1:54365
2013-10-31 18:34:08,373 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47410, dest: /127.0.0.1:54365, bytes: 27389, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7471099473439155231_1138, duration: 303453
2013-10-31 18:34:08,373 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7471099473439155231_1138 terminating
2013-10-31 18:34:08,373 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47126, dest: /127.0.0.1:37740, bytes: 27389, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7471099473439155231_1138, duration: 1021676
2013-10-31 18:34:08,374 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7471099473439155231_1138 terminating
2013-10-31 18:34:08,374 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43234, dest: /127.0.0.1:59471, bytes: 27389, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7471099473439155231_1138, duration: 1943737
2013-10-31 18:34:08,375 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7471099473439155231_1138 terminating
2013-10-31 18:34:08,375 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7471099473439155231_1138 size 27389
2013-10-31 18:34:08,377 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:08,377 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:08,377 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7471099473439155231_1138 size 27389
2013-10-31 18:34:08,378 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7471099473439155231_1138 size 27389
2013-10-31 18:34:08,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml	dst=null	perm=null
2013-10-31 18:34:08,396 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47129, bytes: 27605, op: HDFS_READ, cliID: DFSClient_1053356637, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7471099473439155231_1138, duration: 431494
2013-10-31 18:34:08,415 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0015: nMaps=4 nReduces=0 max=-1
2013-10-31 18:34:08,415 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0015 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:08,415 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0015
2013-10-31 18:34:08,415 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0015	RESULT=SUCCESS
2013-10-31 18:34:08,416 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0015
2013-10-31 18:34:08,417 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0015
2013-10-31 18:34:08,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,450 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml. blk_-2085394991921006793_1140
2013-10-31 18:34:08,452 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2085394991921006793_1140 src: /127.0.0.1:50042 dest: /127.0.0.1:34578
2013-10-31 18:34:08,453 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2085394991921006793_1140 src: /127.0.0.1:43240 dest: /127.0.0.1:59471
2013-10-31 18:34:08,455 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2085394991921006793_1140 src: /127.0.0.1:47132 dest: /127.0.0.1:37740
2013-10-31 18:34:08,459 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47132, dest: /127.0.0.1:37740, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2085394991921006793_1140, duration: 397563
2013-10-31 18:34:08,459 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2085394991921006793_1140 terminating
2013-10-31 18:34:08,460 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43240, dest: /127.0.0.1:59471, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2085394991921006793_1140, duration: 2111481
2013-10-31 18:34:08,461 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2085394991921006793_1140 terminating
2013-10-31 18:34:08,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50042, dest: /127.0.0.1:34578, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2085394991921006793_1140, duration: 2379856
2013-10-31 18:34:08,462 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2085394991921006793_1140 size 27454
2013-10-31 18:34:08,462 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2085394991921006793_1140 terminating
2013-10-31 18:34:08,464 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2085394991921006793_1140 size 27454
2013-10-31 18:34:08,464 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml from client DFSClient_1053356637
2013-10-31 18:34:08,465 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml is closed by DFSClient_1053356637
2013-10-31 18:34:08,465 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2085394991921006793_1140 size 27454
2013-10-31 18:34:08,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,475 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken. blk_-7689919938199943373_1141
2013-10-31 18:34:08,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7689919938199943373_1141 src: /127.0.0.1:43242 dest: /127.0.0.1:59471
2013-10-31 18:34:08,479 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7689919938199943373_1141 src: /127.0.0.1:50046 dest: /127.0.0.1:34578
2013-10-31 18:34:08,480 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7689919938199943373_1141 src: /127.0.0.1:47135 dest: /127.0.0.1:37740
2013-10-31 18:34:08,483 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47135, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7689919938199943373_1141, duration: 67512
2013-10-31 18:34:08,484 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7689919938199943373_1141 terminating
2013-10-31 18:34:08,484 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50046, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7689919938199943373_1141, duration: 871968
2013-10-31 18:34:08,485 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7689919938199943373_1141 terminating
2013-10-31 18:34:08,485 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43242, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7689919938199943373_1141, duration: 2011737
2013-10-31 18:34:08,486 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7689919938199943373_1141 terminating
2013-10-31 18:34:08,487 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7689919938199943373_1141 size 116
2013-10-31 18:34:08,489 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:08,490 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:08,490 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7689919938199943373_1141 size 116
2013-10-31 18:34:08,490 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7689919938199943373_1141 size 116
2013-10-31 18:34:08,494 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken
2013-10-31 18:34:08,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:34:08,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43245, bytes: 160, op: HDFS_READ, cliID: DFSClient_1053356637, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6288635088291707302_1137, duration: 271530
2013-10-31 18:34:08,499 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0015 = 1449. Number of splits = 4
2013-10-31 18:34:08,500 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,500 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,500 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,503 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,503 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0015 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:08,503 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0015 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:34:08,690 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:08,691 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:08,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,934 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml. blk_-3748124066677778040_1142
2013-10-31 18:34:08,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3748124066677778040_1142 src: /127.0.0.1:43246 dest: /127.0.0.1:59471
2013-10-31 18:34:08,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3748124066677778040_1142 src: /127.0.0.1:50050 dest: /127.0.0.1:34578
2013-10-31 18:34:08,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3748124066677778040_1142 src: /127.0.0.1:47422 dest: /127.0.0.1:54365
2013-10-31 18:34:08,942 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47422, dest: /127.0.0.1:54365, bytes: 27393, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3748124066677778040_1142, duration: 159839
2013-10-31 18:34:08,942 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3748124066677778040_1142 terminating
2013-10-31 18:34:08,943 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50050, dest: /127.0.0.1:34578, bytes: 27393, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3748124066677778040_1142, duration: 956407
2013-10-31 18:34:08,943 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3748124066677778040_1142 terminating
2013-10-31 18:34:08,944 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3748124066677778040_1142 size 27393
2013-10-31 18:34:08,944 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43246, dest: /127.0.0.1:59471, bytes: 27393, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3748124066677778040_1142, duration: 2044818
2013-10-31 18:34:08,944 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3748124066677778040_1142 terminating
2013-10-31 18:34:08,949 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3748124066677778040_1142 size 27393
2013-10-31 18:34:08,949 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:08,950 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:08,950 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3748124066677778040_1142 size 27393
2013-10-31 18:34:08,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml	dst=null	perm=null
2013-10-31 18:34:08,964 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50053, bytes: 27609, op: HDFS_READ, cliID: DFSClient_-273342706, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3748124066677778040_1142, duration: 406233
2013-10-31 18:34:08,981 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0014: nMaps=4 nReduces=0 max=-1
2013-10-31 18:34:08,981 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0014 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:08,981 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0014	RESULT=SUCCESS
2013-10-31 18:34:08,981 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0014
2013-10-31 18:34:08,981 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0014
2013-10-31 18:34:08,982 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0014
2013-10-31 18:34:08,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:09,005 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml. blk_1071781393642219275_1144
2013-10-31 18:34:09,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1071781393642219275_1144 src: /127.0.0.1:43251 dest: /127.0.0.1:59471
2013-10-31 18:34:09,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1071781393642219275_1144 src: /127.0.0.1:50055 dest: /127.0.0.1:34578
2013-10-31 18:34:09,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1071781393642219275_1144 src: /127.0.0.1:47144 dest: /127.0.0.1:37740
2013-10-31 18:34:09,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47144, dest: /127.0.0.1:37740, bytes: 27458, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1071781393642219275_1144, duration: 503655
2013-10-31 18:34:09,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1071781393642219275_1144 terminating
2013-10-31 18:34:09,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50055, dest: /127.0.0.1:34578, bytes: 27458, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1071781393642219275_1144, duration: 1428614
2013-10-31 18:34:09,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1071781393642219275_1144 terminating
2013-10-31 18:34:09,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1071781393642219275_1144 size 27458
2013-10-31 18:34:09,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43251, dest: /127.0.0.1:59471, bytes: 27458, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1071781393642219275_1144, duration: 2517784
2013-10-31 18:34:09,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1071781393642219275_1144 terminating
2013-10-31 18:34:09,019 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1071781393642219275_1144 size 27458
2013-10-31 18:34:09,019 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml from client DFSClient_-273342706
2013-10-31 18:34:09,020 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml is closed by DFSClient_-273342706
2013-10-31 18:34:09,020 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1071781393642219275_1144 size 27458
2013-10-31 18:34:09,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:09,036 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken. blk_-9072395253391421232_1145
2013-10-31 18:34:09,040 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072395253391421232_1145 src: /127.0.0.1:47145 dest: /127.0.0.1:37740
2013-10-31 18:34:09,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072395253391421232_1145 src: /127.0.0.1:47429 dest: /127.0.0.1:54365
2013-10-31 18:34:09,043 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072395253391421232_1145 src: /127.0.0.1:50059 dest: /127.0.0.1:34578
2013-10-31 18:34:09,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50059, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9072395253391421232_1145, duration: 87775
2013-10-31 18:34:09,047 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9072395253391421232_1145 terminating
2013-10-31 18:34:09,047 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9072395253391421232_1145 size 116
2013-10-31 18:34:09,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47429, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9072395253391421232_1145, duration: 998569
2013-10-31 18:34:09,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9072395253391421232_1145 terminating
2013-10-31 18:34:09,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47145, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072395253391421232_1145, duration: 1914480
2013-10-31 18:34:09,049 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9072395253391421232_1145 terminating
2013-10-31 18:34:09,051 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9072395253391421232_1145 size 116
2013-10-31 18:34:09,051 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:09,052 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:09,052 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9072395253391421232_1145 size 116
2013-10-31 18:34:09,056 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken
2013-10-31 18:34:09,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:34:09,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47431, bytes: 160, op: HDFS_READ, cliID: DFSClient_-273342706, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6337612719236416595_1137, duration: 263511
2013-10-31 18:34:09,063 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0014 = 1449. Number of splits = 4
2013-10-31 18:34:09,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,065 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,065 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,065 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,066 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,066 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,066 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0014 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:09,068 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0014 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:34:09,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5501218942350876546_1124 file build/test/data/dfs/data/data1/current/blk_-5501218942350876546 for deletion
2013-10-31 18:34:09,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data2/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:09,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5501218942350876546_1124 at file build/test/data/dfs/data/data1/current/blk_-5501218942350876546
2013-10-31 18:34:09,187 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3041080366967563833_1110 file build/test/data/dfs/data/data2/current/blk_-3041080366967563833 for deletion
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data2/current/blk_-3922365374298370577
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2009759733485207989_1121 file build/test/data/dfs/data/data1/current/blk_-2009759733485207989 for deletion
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3041080366967563833_1110 at file build/test/data/dfs/data/data2/current/blk_-3041080366967563833
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_548298036330803898_1113 file build/test/data/dfs/data/data1/current/blk_548298036330803898 for deletion
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2009759733485207989_1121 at file build/test/data/dfs/data/data1/current/blk_-2009759733485207989
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1328316139791502870_1112 file build/test/data/dfs/data/data2/current/blk_1328316139791502870 for deletion
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_548298036330803898_1113 at file build/test/data/dfs/data/data1/current/blk_548298036330803898
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data1/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1328316139791502870_1112 at file build/test/data/dfs/data/data2/current/blk_1328316139791502870
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7462121373986728613_1119 file build/test/data/dfs/data/data1/current/blk_7462121373986728613 for deletion
2013-10-31 18:34:09,188 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data1/current/blk_2114727610416078497
2013-10-31 18:34:09,189 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7462121373986728613_1119 at file build/test/data/dfs/data/data1/current/blk_7462121373986728613
2013-10-31 18:34:09,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data8/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:09,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_548298036330803898_1113 file build/test/data/dfs/data/data7/current/blk_548298036330803898 for deletion
2013-10-31 18:34:09,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data8/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:09,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_548298036330803898_1113 at file build/test/data/dfs/data/data7/current/blk_548298036330803898
2013-10-31 18:34:09,260 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data8/current/blk_-3922365374298370577
2013-10-31 18:34:09,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data8/current/blk_2114727610416078497
2013-10-31 18:34:10,248 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0014_m_000005_0' to tip task_20131031182606197_0014_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:10,252 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:34:10,253 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,253 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:10,253 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,253 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0013 being deleted.
2013-10-31 18:34:10,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken	dst=null	perm=null
2013-10-31 18:34:10,258 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47149, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072395253391421232_1145, duration: 311185
2013-10-31 18:34:10,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml	dst=null	perm=null
2013-10-31 18:34:10,267 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47434, bytes: 27609, op: HDFS_READ, cliID: DFSClient_2002082125, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3748124066677778040_1142, duration: 503032
2013-10-31 18:34:10,293 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:10,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar	dst=null	perm=null
2013-10-31 18:34:10,326 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43261, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2002082125, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6248130088879987270_1132, duration: 1485097
2013-10-31 18:34:10,338 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0015_m_000005_0' to tip task_20131031182606197_0015_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:10,347 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:34:10,347 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,347 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken	dst=null	perm=null
2013-10-31 18:34:10,355 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43262, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7689919938199943373_1141, duration: 284815
2013-10-31 18:34:10,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml	dst=null	perm=null
2013-10-31 18:34:10,365 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47155, bytes: 27605, op: HDFS_READ, cliID: DFSClient_-914049183, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7471099473439155231_1138, duration: 394558
2013-10-31 18:34:10,387 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:10,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar	dst=null	perm=null
2013-10-31 18:34:10,401 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43265, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-914049183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5720203401911213791_1133, duration: 869888
2013-10-31 18:34:10,415 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_-251095346
2013-10-31 18:34:10,415 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_-251095346 spawned.
2013-10-31 18:34:10,417 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000005_0/taskjvm.sh
2013-10-31 18:34:10,428 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_5720203401911213791_1133 to datanode(s) 127.0.0.1:37740
2013-10-31 18:34:10,428 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_6248130088879987270_1132 to datanode(s) 127.0.0.1:54365
2013-10-31 18:34:10,429 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_548298036330803898_1113 blk_-5501218942350876546_1124 blk_1328316139791502870_1112 blk_-3041080366967563833_1110
2013-10-31 18:34:10,429 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-5501218942350876546_1124 blk_1328316139791502870_1112 blk_-3041080366967563833_1110
2013-10-31 18:34:10,468 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_428164535
2013-10-31 18:34:10,468 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_428164535 spawned.
2013-10-31 18:34:10,469 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000005_0/taskjvm.sh
2013-10-31 18:34:11,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5501218942350876546_1124 file build/test/data/dfs/data/data4/current/blk_-5501218942350876546 for deletion
2013-10-31 18:34:11,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3041080366967563833_1110 file build/test/data/dfs/data/data3/current/blk_-3041080366967563833 for deletion
2013-10-31 18:34:11,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5501218942350876546_1124 at file build/test/data/dfs/data/data4/current/blk_-5501218942350876546
2013-10-31 18:34:11,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3041080366967563833_1110 at file build/test/data/dfs/data/data3/current/blk_-3041080366967563833
2013-10-31 18:34:11,063 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_548298036330803898_1113 file build/test/data/dfs/data/data4/current/blk_548298036330803898 for deletion
2013-10-31 18:34:11,064 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_548298036330803898_1113 at file build/test/data/dfs/data/data4/current/blk_548298036330803898
2013-10-31 18:34:11,064 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1328316139791502870_1112 file build/test/data/dfs/data/data3/current/blk_1328316139791502870 for deletion
2013-10-31 18:34:11,064 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1328316139791502870_1112 at file build/test/data/dfs/data/data3/current/blk_1328316139791502870
2013-10-31 18:34:11,791 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_5720203401911213791_1133 to 127.0.0.1:37740 
2013-10-31 18:34:11,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5501218942350876546_1124 file build/test/data/dfs/data/data5/current/blk_-5501218942350876546 for deletion
2013-10-31 18:34:11,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3041080366967563833_1110 file build/test/data/dfs/data/data5/current/blk_-3041080366967563833 for deletion
2013-10-31 18:34:11,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5501218942350876546_1124 at file build/test/data/dfs/data/data5/current/blk_-5501218942350876546
2013-10-31 18:34:11,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1328316139791502870_1112 file build/test/data/dfs/data/data5/current/blk_1328316139791502870 for deletion
2013-10-31 18:34:11,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3041080366967563833_1110 at file build/test/data/dfs/data/data5/current/blk_-3041080366967563833
2013-10-31 18:34:11,792 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1328316139791502870_1112 at file build/test/data/dfs/data/data5/current/blk_1328316139791502870
2013-10-31 18:34:11,793 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_5720203401911213791_1133 to /127.0.0.1:37740
2013-10-31 18:34:11,793 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:47157 dest: /127.0.0.1:37740
2013-10-31 18:34:11,795 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5720203401911213791_1133 src: /127.0.0.1:47157 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:34:11,798 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:12,188 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_6248130088879987270_1132 to 127.0.0.1:54365 
2013-10-31 18:34:12,189 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:47442 dest: /127.0.0.1:54365
2013-10-31 18:34:12,189 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_6248130088879987270_1132 to /127.0.0.1:54365
2013-10-31 18:34:12,191 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6248130088879987270_1132 src: /127.0.0.1:47442 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:34:12,192 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:12,309 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-251095346 given task: attempt_20131031182606197_0014_m_000005_0
2013-10-31 18:34:12,333 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:12,333 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0013_m_000001_0 not found in cache
2013-10-31 18:34:12,333 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383330852333
2013-10-31 18:34:12,356 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_428164535 given task: attempt_20131031182606197_0015_m_000005_0
2013-10-31 18:34:12,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:12,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:13,667 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0013_m_-137784207 since job job_20131031182606197_0013 is dead
2013-10-31 18:34:13,678 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23873 with signal TERM. Exit code 0
2013-10-31 18:34:13,736 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0013_r_-2042360792 since job job_20131031182606197_0013 is dead
2013-10-31 18:34:13,742 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23951 with signal TERM. Exit code 0
2013-10-31 18:34:13,817 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0013_m_932760728 since job job_20131031182606197_0013 is dead
2013-10-31 18:34:13,821 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23709 with signal TERM. Exit code 0
2013-10-31 18:34:13,903 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:13,903 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:13,904 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:13,904 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0013_m_-137784207 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:13,907 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:13,907 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:13,907 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:13,907 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0013_r_-2042360792 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:13,990 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:13,990 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:13,990 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:13,992 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0013_m_932760728 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:34:15,774 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000005_0 0.0% setup
2013-10-31 18:34:15,777 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000005_0 is done.
2013-10-31 18:34:15,777 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000005_0  was -1
2013-10-31 18:34:15,777 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:15,779 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000005_0 0.0% setup
2013-10-31 18:34:15,781 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000005_0 is done.
2013-10-31 18:34:15,782 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000005_0  was -1
2013-10-31 18:34:15,782 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:16,258 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000005_0' has completed task_20131031182606197_0014_m_000005 successfully.
2013-10-31 18:34:16,262 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000000_0' to tip task_20131031182606197_0014_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:16,263 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000000
2013-10-31 18:34:16,264 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:34:16,265 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,265 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,302 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_-838970058
2013-10-31 18:34:16,303 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_-838970058 spawned.
2013-10-31 18:34:16,306 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000000_0/taskjvm.sh
2013-10-31 18:34:16,352 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000005_0' has completed task_20131031182606197_0015_m_000005 successfully.
2013-10-31 18:34:16,357 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000000_0' to tip task_20131031182606197_0015_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:16,358 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000000
2013-10-31 18:34:16,359 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000001_0' to tip task_20131031182606197_0015_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:16,359 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000001
2013-10-31 18:34:16,361 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000002_0' to tip task_20131031182606197_0015_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:16,362 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:34:16,362 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000002
2013-10-31 18:34:16,363 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:16,363 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000003_0' to tip task_20131031182606197_0015_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:16,363 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,364 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,365 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000003
2013-10-31 18:34:16,365 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,365 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0015_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,369 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:34:16,371 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:34:16,371 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,371 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,372 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000003_0 which needs 1 slots
2013-10-31 18:34:16,372 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0015_m_000003_0 which needs 1 slots
2013-10-31 18:34:16,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken	dst=null	perm=null
2013-10-31 18:34:16,382 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43273, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7689919938199943373_1141, duration: 313744
2013-10-31 18:34:16,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml	dst=null	perm=null
2013-10-31 18:34:16,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43275, bytes: 27605, op: HDFS_READ, cliID: DFSClient_-83613591, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7471099473439155231_1138, duration: 394957
2013-10-31 18:34:16,394 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000001_0' to tip task_20131031182606197_0014_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:16,394 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000001
2013-10-31 18:34:16,395 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000002_0' to tip task_20131031182606197_0014_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:16,395 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000002
2013-10-31 18:34:16,397 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:16,399 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:34:16,399 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,399 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,400 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,400 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0014_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken	dst=null	perm=null
2013-10-31 18:34:16,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47167, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072395253391421232_1145, duration: 117706
2013-10-31 18:34:16,406 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_-550848985
2013-10-31 18:34:16,407 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_-550848985 spawned.
2013-10-31 18:34:16,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml	dst=null	perm=null
2013-10-31 18:34:16,408 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0015/attempt_20131031182606197_0015_m_000001_0. Attempting to reuse: jvm_20131031182606197_0015_m_428164535
2013-10-31 18:34:16,409 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000000_0/taskjvm.sh
2013-10-31 18:34:16,409 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43278, bytes: 27609, op: HDFS_READ, cliID: DFSClient_-1373575222, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3748124066677778040_1142, duration: 165108
2013-10-31 18:34:16,413 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:16,421 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:16,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar	dst=null	perm=null
2013-10-31 18:34:16,427 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43279, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-83613591, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5720203401911213791_1133, duration: 571915
2013-10-31 18:34:16,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar	dst=null	perm=null
2013-10-31 18:34:16,435 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47454, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1373575222, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6248130088879987270_1132, duration: 642597
2013-10-31 18:34:16,559 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_1010098939
2013-10-31 18:34:16,560 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_1010098939 spawned.
2013-10-31 18:34:16,560 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_-1312562418
2013-10-31 18:34:16,561 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_-1312562418 spawned.
2013-10-31 18:34:16,563 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000002_0/taskjvm.sh
2013-10-31 18:34:16,564 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000001_0/taskjvm.sh
2013-10-31 18:34:16,802 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_-773358262
2013-10-31 18:34:16,803 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_-773358262 spawned.
2013-10-31 18:34:16,803 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_-699255952
2013-10-31 18:34:16,804 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_-699255952 spawned.
2013-10-31 18:34:16,805 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000002_0/taskjvm.sh
2013-10-31 18:34:16,805 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000003_0/taskjvm.sh
2013-10-31 18:34:16,826 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_428164535 given task: attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:16,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=null
2013-10-31 18:34:16,927 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47173, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6521390248325677253_1135, duration: 166608
2013-10-31 18:34:16,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:16,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:17,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:17,006 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 186 raw values into 1 aggregated values, total 21
2013-10-31 18:34:17,167 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47458, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 226045
2013-10-31 18:34:17,171 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001. blk_7675524486983705989_1146
2013-10-31 18:34:17,189 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7675524486983705989_1146 src: /127.0.0.1:43285 dest: /127.0.0.1:59471
2013-10-31 18:34:17,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7675524486983705989_1146 src: /127.0.0.1:47177 dest: /127.0.0.1:37740
2013-10-31 18:34:17,191 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7675524486983705989_1146 src: /127.0.0.1:50090 dest: /127.0.0.1:34578
2013-10-31 18:34:17,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50090, dest: /127.0.0.1:34578, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7675524486983705989_1146, duration: 1370663
2013-10-31 18:34:17,193 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7675524486983705989_1146 terminating
2013-10-31 18:34:17,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47177, dest: /127.0.0.1:37740, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7675524486983705989_1146, duration: 1740534
2013-10-31 18:34:17,194 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7675524486983705989_1146 terminating
2013-10-31 18:34:17,194 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7675524486983705989_1146 size 134
2013-10-31 18:34:17,194 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43285, dest: /127.0.0.1:59471, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7675524486983705989_1146, duration: 2188993
2013-10-31 18:34:17,194 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7675524486983705989_1146 terminating
2013-10-31 18:34:17,194 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7675524486983705989_1146 size 134
2013-10-31 18:34:17,196 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:17,196 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:17,198 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7675524486983705989_1146 size 134
2013-10-31 18:34:17,252 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:17,253 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000001_0 0.0% 
2013-10-31 18:34:17,319 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-838970058 given task: attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:17,376 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_4102379777415512644_1030
2013-10-31 18:34:17,579 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-550848985 given task: attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:17,755 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-1312562418 given task: attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:17,766 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_1010098939 given task: attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:17,809 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-773358262 given task: attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:17,824 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-699255952 given task: attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:17,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=null
2013-10-31 18:34:17,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50097, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6443718356478161979_1135, duration: 205622
2013-10-31 18:34:17,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:17,896 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47469, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 137952
2013-10-31 18:34:17,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=null
2013-10-31 18:34:18,123 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50100, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6521390248325677253_1135, duration: 184451
2013-10-31 18:34:18,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:18,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50101, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 126628
2013-10-31 18:34:18,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,306 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000. blk_-4210927453857164432_1148
2013-10-31 18:34:18,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=null
2013-10-31 18:34:18,331 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4210927453857164432_1148 src: /127.0.0.1:47193 dest: /127.0.0.1:37740
2013-10-31 18:34:18,332 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4210927453857164432_1148 src: /127.0.0.1:43303 dest: /127.0.0.1:59471
2013-10-31 18:34:18,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4210927453857164432_1148 src: /127.0.0.1:50107 dest: /127.0.0.1:34578
2013-10-31 18:34:18,335 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50107, dest: /127.0.0.1:34578, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4210927453857164432_1148, duration: 1553808
2013-10-31 18:34:18,336 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47479, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6443718356478161979_1135, duration: 166486
2013-10-31 18:34:18,336 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4210927453857164432_1148 terminating
2013-10-31 18:34:18,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43303, dest: /127.0.0.1:59471, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4210927453857164432_1148, duration: 1580742
2013-10-31 18:34:18,336 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4210927453857164432_1148 terminating
2013-10-31 18:34:18,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47193, dest: /127.0.0.1:37740, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4210927453857164432_1148, duration: 2191213
2013-10-31 18:34:18,337 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4210927453857164432_1148 terminating
2013-10-31 18:34:18,339 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4210927453857164432_1148 size 181
2013-10-31 18:34:18,339 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4210927453857164432_1148 size 181
2013-10-31 18:34:18,340 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4210927453857164432_1148 size 181
2013-10-31 18:34:18,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=null
2013-10-31 18:34:18,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=null
2013-10-31 18:34:18,351 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47197, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6521390248325677253_1135, duration: 159878
2013-10-31 18:34:18,352 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47198, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6443718356478161979_1135, duration: 149826
2013-10-31 18:34:18,352 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:18,353 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:18,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:18,376 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47200, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 170132
2013-10-31 18:34:18,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:18,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:18,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47484, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 152737
2013-10-31 18:34:18,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,398 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,398 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000000_0 0.0% 
2013-10-31 18:34:18,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split	dst=null	perm=null
2013-10-31 18:34:18,439 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43311, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6521390248325677253_1135, duration: 129490
2013-10-31 18:34:18,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:18,479 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47486, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 176550
2013-10-31 18:34:18,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,555 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:18,555 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:18,575 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50116, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 191427
2013-10-31 18:34:18,575 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:18,575 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:18,582 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:18,582 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:18,604 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,604 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000002_0 0.0% 
2013-10-31 18:34:18,621 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,622 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000002_0 0.0% 
2013-10-31 18:34:18,627 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,627 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000001_0 0.0% 
2013-10-31 18:34:18,664 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:18,665 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:18,709 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,710 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000003_0 0.0% 
2013-10-31 18:34:18,739 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:18,739 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:19,267 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000003_0' to tip task_20131031182606197_0014_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:19,268 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000003
2013-10-31 18:34:19,270 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:34:19,270 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000003_0 which needs 1 slots
2013-10-31 18:34:19,271 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0014_m_000003_0 which needs 1 slots
2013-10-31 18:34:19,306 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0014/attempt_20131031182606197_0014_m_000003_0. Attempting to reuse: jvm_20131031182606197_0014_m_-251095346
2013-10-31 18:34:19,329 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-251095346 given task: attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:19,364 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:19,364 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:19,370 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:19,370 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:19,399 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:19,399 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:19,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0	dst=null	perm=null
2013-10-31 18:34:19,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split	dst=null	perm=null
2013-10-31 18:34:19,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50118, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6443718356478161979_1135, duration: 174792
2013-10-31 18:34:19,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:19,505 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50119, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 379349
2013-10-31 18:34:19,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0	dst=null	perm=null
2013-10-31 18:34:19,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0	dst=null	perm=null
2013-10-31 18:34:19,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0	dst=null	perm=null
2013-10-31 18:34:19,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0	dst=null	perm=null
2013-10-31 18:34:19,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0	dst=null	perm=null
2013-10-31 18:34:19,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0	dst=null	perm=null
2013-10-31 18:34:19,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0	dst=null	perm=null
2013-10-31 18:34:19,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0	dst=null	perm=null
2013-10-31 18:34:19,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,722 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:19,722 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000000_0 0.0% 
2013-10-31 18:34:19,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0	dst=null	perm=null
2013-10-31 18:34:19,856 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003. blk_9191423163742438852_1153
2013-10-31 18:34:19,873 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9191423163742438852_1153 src: /127.0.0.1:50120 dest: /127.0.0.1:34578
2013-10-31 18:34:19,874 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9191423163742438852_1153 src: /127.0.0.1:47209 dest: /127.0.0.1:37740
2013-10-31 18:34:19,875 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9191423163742438852_1153 src: /127.0.0.1:47493 dest: /127.0.0.1:54365
2013-10-31 18:34:19,877 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47493, dest: /127.0.0.1:54365, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9191423163742438852_1153, duration: 1446386
2013-10-31 18:34:19,878 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9191423163742438852_1153 terminating
2013-10-31 18:34:19,878 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9191423163742438852_1153 size 180
2013-10-31 18:34:19,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47209, dest: /127.0.0.1:37740, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9191423163742438852_1153, duration: 1905945
2013-10-31 18:34:19,878 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9191423163742438852_1153 terminating
2013-10-31 18:34:19,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50120, dest: /127.0.0.1:34578, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9191423163742438852_1153, duration: 2347985
2013-10-31 18:34:19,879 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9191423163742438852_1153 terminating
2013-10-31 18:34:19,879 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9191423163742438852_1153 size 180
2013-10-31 18:34:19,881 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:19,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:19,883 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9191423163742438852_1153 size 180
2013-10-31 18:34:19,983 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:19,984 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000003_0 0.0% 
2013-10-31 18:34:20,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0	dst=null	perm=null
2013-10-31 18:34:20,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:20,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:20,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0	dst=null	perm=null
2013-10-31 18:34:21,051 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:21,052 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000000_0 is done.
2013-10-31 18:34:21,053 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000000_0  was -1
2013-10-31 18:34:21,053 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:21,261 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:21,263 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000002_0 is done.
2013-10-31 18:34:21,263 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000002_0  was -1
2013-10-31 18:34:21,264 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:21,265 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0014_m_000005_0
2013-10-31 18:34:21,265 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0014_m_000005_0
2013-10-31 18:34:21,266 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000005_0 not found in cache
2013-10-31 18:34:21,268 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:21,269 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:21,270 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000001_0 is done.
2013-10-31 18:34:21,270 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000001_0  was -1
2013-10-31 18:34:21,270 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:21,271 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000002_0 is done.
2013-10-31 18:34:21,272 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000002_0  was -1
2013-10-31 18:34:21,272 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:21,364 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0015_m_000005_0
2013-10-31 18:34:21,364 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0015_m_000005_0
2013-10-31 18:34:21,364 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000005_0 not found in cache
2013-10-31 18:34:21,367 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:21,369 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000003_0 is done.
2013-10-31 18:34:21,369 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000003_0  was -1
2013-10-31 18:34:21,369 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:22,275 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:22,275 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:22,366 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000000_0' has completed task_20131031182606197_0015_m_000000 successfully.
2013-10-31 18:34:22,372 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000002_0' has completed task_20131031182606197_0015_m_000002 successfully.
2013-10-31 18:34:22,372 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000003_0' has completed task_20131031182606197_0015_m_000003 successfully.
2013-10-31 18:34:22,400 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000001_0' has completed task_20131031182606197_0014_m_000001 successfully.
2013-10-31 18:34:22,401 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000002_0' has completed task_20131031182606197_0014_m_000002 successfully.
2013-10-31 18:34:22,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0	dst=null	perm=null
2013-10-31 18:34:22,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:22,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:22,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0	dst=null	perm=null
2013-10-31 18:34:22,942 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:22,947 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:22,949 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000001_0 is done.
2013-10-31 18:34:22,949 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000001_0  was -1
2013-10-31 18:34:22,950 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:22,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0	dst=null	perm=null
2013-10-31 18:34:23,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:23,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:23,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0	dst=null	perm=null
2013-10-31 18:34:23,824 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:23,826 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:23,827 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000000_0 is done.
2013-10-31 18:34:23,827 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000000_0  was -1
2013-10-31 18:34:23,827 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:25,279 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000000_0' has completed task_20131031182606197_0014_m_000000 successfully.
2013-10-31 18:34:25,369 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000001_0' has completed task_20131031182606197_0015_m_000001 successfully.
2013-10-31 18:34:25,373 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0015_m_000004_0' to tip task_20131031182606197_0015_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:25,375 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:34:25,376 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000004_0 which needs 1 slots
2013-10-31 18:34:25,376 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000004_0 which needs 1 slots
2013-10-31 18:34:25,409 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0015/attempt_20131031182606197_0015_m_000004_0. Attempting to reuse: jvm_20131031182606197_0015_m_-550848985
2013-10-31 18:34:25,466 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:25,468 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:25,469 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000003_0 is done.
2013-10-31 18:34:25,470 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000003_0  was -1
2013-10-31 18:34:25,470 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:26,118 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-550848985 given task: attempt_20131031182606197_0015_m_000004_0
2013-10-31 18:34:26,225 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000004_0 0.0% 
2013-10-31 18:34:26,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary	dst=null	perm=null
2013-10-31 18:34:26,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:26,256 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_SUCCESS from client DFSClient_attempt_20131031182606197_0015_m_000004_0
2013-10-31 18:34:26,256 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0015_m_000004_0
2013-10-31 18:34:26,265 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,265 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:26,265 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:26,265 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,266 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:26,266 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:26,266 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,266 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,267 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6288635088291707302 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,267 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6288635088291707302 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,267 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6288635088291707302 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:26,267 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7471099473439155231 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,267 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7471099473439155231 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,268 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7471099473439155231 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:26,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015	dst=null	perm=null
2013-10-31 18:34:28,286 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000003_0' has completed task_20131031182606197_0014_m_000003 successfully.
2013-10-31 18:34:28,328 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0014_m_000004_0' to tip task_20131031182606197_0014_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:28,330 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:34:28,331 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000004_0 which needs 1 slots
2013-10-31 18:34:28,331 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000004_0 which needs 1 slots
2013-10-31 18:34:28,399 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0014/attempt_20131031182606197_0014_m_000004_0. Attempting to reuse: jvm_20131031182606197_0014_m_-251095346
2013-10-31 18:34:28,432 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-7471099473439155231_1138 blk_6521390248325677253_1135 blk_5720203401911213791_1133
2013-10-31 18:34:28,433 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-7471099473439155231_1138 blk_6288635088291707302_1137 blk_6521390248325677253_1135 blk_5720203401911213791_1133
2013-10-31 18:34:28,998 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-251095346 given task: attempt_20131031182606197_0014_m_000004_0
2013-10-31 18:34:29,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7471099473439155231_1138 file build/test/data/dfs/data/data4/current/blk_-7471099473439155231 for deletion
2013-10-31 18:34:29,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data4/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:29,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7471099473439155231_1138 at file build/test/data/dfs/data/data4/current/blk_-7471099473439155231
2013-10-31 18:34:29,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data4/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:29,069 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data4/current/blk_5720203401911213791
2013-10-31 18:34:29,069 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data4/current/blk_6521390248325677253
2013-10-31 18:34:29,104 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000004_0 0.0% 
2013-10-31 18:34:29,106 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 811 Total time for transactions(ms): 21Number of transactions batched in Syncs: 69 Number of syncs: 557 SyncTimes(ms): 57590 12652 
2013-10-31 18:34:29,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary	dst=null	perm=null
2013-10-31 18:34:29,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:29,116 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_SUCCESS from client DFSClient_attempt_20131031182606197_0014_m_000004_0
2013-10-31 18:34:29,116 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0014_m_000004_0
2013-10-31 18:34:29,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:29,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:29,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,123 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,124 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:29,124 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,124 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:29,124 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,124 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6337612719236416595 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,125 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6337612719236416595 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:29,125 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6337612719236416595 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,125 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3748124066677778040 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,125 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3748124066677778040 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:29,125 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3748124066677778040 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014	dst=null	perm=null
2013-10-31 18:34:29,194 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000004_0 0.0% cleanup
2013-10-31 18:34:29,195 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000004_0 is done.
2013-10-31 18:34:29,195 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000004_0  was -1
2013-10-31 18:34:29,195 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:29,798 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7471099473439155231_1138 file build/test/data/dfs/data/data5/current/blk_-7471099473439155231 for deletion
2013-10-31 18:34:29,798 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data5/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:29,798 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7471099473439155231_1138 at file build/test/data/dfs/data/data5/current/blk_-7471099473439155231
2013-10-31 18:34:29,799 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6288635088291707302_1137 file build/test/data/dfs/data/data6/current/blk_6288635088291707302 for deletion
2013-10-31 18:34:29,799 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data5/current/blk_5720203401911213791
2013-10-31 18:34:29,799 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data5/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:29,799 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6288635088291707302_1137 at file build/test/data/dfs/data/data6/current/blk_6288635088291707302
2013-10-31 18:34:29,800 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data5/current/blk_6521390248325677253
2013-10-31 18:34:31,381 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000004_0' has completed task_20131031182606197_0015_m_000004 successfully.
2013-10-31 18:34:31,382 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0015 has completed successfully.
2013-10-31 18:34:31,383 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0015,submitTime=1383244448383,launchTime=1383244448503,firstMapTaskLaunchTime=1383244456357,firstJobSetupTaskLaunchTime=1383244450338,firstJobCleanupTaskLaunchTime=1383244465372,finishTime=1383244471382,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[171DD45149DA44B791799BCE9F119D10/A40DB423CB6E4633A5191EA4B939F931] left+right/(2/2) ...eldedpipesplatform/split1
2013-10-31 18:34:31,391 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633. blk_4749128138481676338_1155
2013-10-31 18:34:31,392 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4749128138481676338_1155 src: /127.0.0.1:47497 dest: /127.0.0.1:54365
2013-10-31 18:34:31,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4749128138481676338_1155 src: /127.0.0.1:43324 dest: /127.0.0.1:59471
2013-10-31 18:34:31,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4749128138481676338_1155 src: /127.0.0.1:50128 dest: /127.0.0.1:34578
2013-10-31 18:34:31,405 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50128, dest: /127.0.0.1:34578, bytes: 21727, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4749128138481676338_1155, duration: 4903043
2013-10-31 18:34:31,405 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4749128138481676338_1155 terminating
2013-10-31 18:34:31,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4749128138481676338_1155 size 21727
2013-10-31 18:34:31,406 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43324, dest: /127.0.0.1:59471, bytes: 21727, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4749128138481676338_1155, duration: 4325288
2013-10-31 18:34:31,406 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4749128138481676338_1155 terminating
2013-10-31 18:34:31,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4749128138481676338_1155 size 21727
2013-10-31 18:34:31,407 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47497, dest: /127.0.0.1:54365, bytes: 21727, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4749128138481676338_1155, duration: 4598147
2013-10-31 18:34:31,408 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4749128138481676338_1155 terminating
2013-10-31 18:34:31,412 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4749128138481676338_1155 size 21727
2013-10-31 18:34:31,412 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 from client DFSClient_1053356637
2013-10-31 18:34:31,413 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 is closed by DFSClient_1053356637
2013-10-31 18:34:31,419 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:31,420 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000000_0'
2013-10-31 18:34:31,420 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000001_0'
2013-10-31 18:34:31,420 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000004_0'
2013-10-31 18:34:31,421 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000005_0'
2013-10-31 18:34:31,422 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7689919938199943373 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:31,423 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7689919938199943373 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:31,423 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:31,423 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0015 being deleted.
2013-10-31 18:34:31,423 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7689919938199943373 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:31,423 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000002_0'
2013-10-31 18:34:31,424 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000003_0'
2013-10-31 18:34:31,426 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0015_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:31,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015	dst=null	perm=null
2013-10-31 18:34:31,433 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_6337612719236416595_1137 blk_6288635088291707302_1137 blk_6248130088879987270_1132 blk_-3748124066677778040_1142 blk_6521390248325677253_1135 blk_-7689919938199943373_1141 blk_-6443718356478161979_1135 blk_5720203401911213791_1133
2013-10-31 18:34:31,434 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_6337612719236416595_1137 blk_-7471099473439155231_1138 blk_6288635088291707302_1137 blk_6248130088879987270_1132 blk_6521390248325677253_1135 blk_-7689919938199943373_1141 blk_-6443718356478161979_1135 blk_5720203401911213791_1133
2013-10-31 18:34:32,078 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000004_0 0.0% cleanup
2013-10-31 18:34:32,079 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000004_0 is done.
2013-10-31 18:34:32,079 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000004_0  was -1
2013-10-31 18:34:32,080 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:33,196 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7689919938199943373_1141 file build/test/data/dfs/data/data1/current/blk_-7689919938199943373 for deletion
2013-10-31 18:34:33,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data2/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:33,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7689919938199943373_1141 at file build/test/data/dfs/data/data1/current/blk_-7689919938199943373
2013-10-31 18:34:33,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data2/current/blk_-6443718356478161979
2013-10-31 18:34:33,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3748124066677778040_1142 file build/test/data/dfs/data/data2/current/blk_-3748124066677778040 for deletion
2013-10-31 18:34:33,198 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data1/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:33,198 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3748124066677778040_1142 at file build/test/data/dfs/data/data2/current/blk_-3748124066677778040
2013-10-31 18:34:33,198 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data2/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:33,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data1/current/blk_5720203401911213791
2013-10-31 18:34:33,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6288635088291707302_1137 file build/test/data/dfs/data/data1/current/blk_6288635088291707302 for deletion
2013-10-31 18:34:33,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data2/current/blk_6248130088879987270
2013-10-31 18:34:33,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6288635088291707302_1137 at file build/test/data/dfs/data/data1/current/blk_6288635088291707302
2013-10-31 18:34:33,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6337612719236416595_1137 file build/test/data/dfs/data/data2/current/blk_6337612719236416595 for deletion
2013-10-31 18:34:33,200 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data1/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:33,200 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6337612719236416595_1137 at file build/test/data/dfs/data/data2/current/blk_6337612719236416595
2013-10-31 18:34:33,200 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data1/current/blk_6521390248325677253
2013-10-31 18:34:33,269 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7689919938199943373_1141 file build/test/data/dfs/data/data8/current/blk_-7689919938199943373 for deletion
2013-10-31 18:34:33,269 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7471099473439155231_1138 file build/test/data/dfs/data/data8/current/blk_-7471099473439155231 for deletion
2013-10-31 18:34:33,269 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7689919938199943373_1141 at file build/test/data/dfs/data/data8/current/blk_-7689919938199943373
2013-10-31 18:34:33,269 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data8/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:33,270 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7471099473439155231_1138 at file build/test/data/dfs/data/data8/current/blk_-7471099473439155231
2013-10-31 18:34:33,270 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data7/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:33,270 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data8/current/blk_-6443718356478161979
2013-10-31 18:34:33,270 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data7/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:33,271 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data7/current/blk_5720203401911213791
2013-10-31 18:34:33,271 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6288635088291707302_1137 file build/test/data/dfs/data/data7/current/blk_6288635088291707302 for deletion
2013-10-31 18:34:33,271 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data7/current/blk_6248130088879987270
2013-10-31 18:34:33,271 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6337612719236416595_1137 file build/test/data/dfs/data/data8/current/blk_6337612719236416595 for deletion
2013-10-31 18:34:33,271 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6288635088291707302_1137 at file build/test/data/dfs/data/data7/current/blk_6288635088291707302
2013-10-31 18:34:33,272 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data7/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:33,272 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6337612719236416595_1137 at file build/test/data/dfs/data/data8/current/blk_6337612719236416595
2013-10-31 18:34:33,272 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data7/current/blk_6521390248325677253
2013-10-31 18:34:34,338 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000004_0' has completed task_20131031182606197_0014_m_000004 successfully.
2013-10-31 18:34:34,339 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0014 has completed successfully.
2013-10-31 18:34:34,340 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0014,submitTime=1383244448954,launchTime=1383244449067,firstMapTaskLaunchTime=1383244456261,firstJobSetupTaskLaunchTime=1383244450248,firstJobCleanupTaskLaunchTime=1383244468328,finishTime=1383244474339,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[171DD45149DA44B791799BCE9F119D10/F2CCF5EB3F8E47E9901B36D1A1BB76A4] left+right/(1/2) ...eldedpipesplatform/split2
2013-10-31 18:34:34,346 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9. blk_-779614672427365938_1155
2013-10-31 18:34:34,348 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-779614672427365938_1155 src: /127.0.0.1:47509 dest: /127.0.0.1:54365
2013-10-31 18:34:34,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-779614672427365938_1155 src: /127.0.0.1:50139 dest: /127.0.0.1:34578
2013-10-31 18:34:34,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-779614672427365938_1155 src: /127.0.0.1:43337 dest: /127.0.0.1:59471
2013-10-31 18:34:34,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43337, dest: /127.0.0.1:59471, bytes: 22049, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-779614672427365938_1155, duration: 300908
2013-10-31 18:34:34,358 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-779614672427365938_1155 terminating
2013-10-31 18:34:34,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50139, dest: /127.0.0.1:34578, bytes: 22049, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-779614672427365938_1155, duration: 1112987
2013-10-31 18:34:34,359 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-779614672427365938_1155 terminating
2013-10-31 18:34:34,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47509, dest: /127.0.0.1:54365, bytes: 22049, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-779614672427365938_1155, duration: 2069111
2013-10-31 18:34:34,359 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-779614672427365938_1155 terminating
2013-10-31 18:34:34,362 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-779614672427365938_1155 size 22049
2013-10-31 18:34:34,364 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 from client DFSClient_-273342706
2013-10-31 18:34:34,364 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 is closed by DFSClient_-273342706
2013-10-31 18:34:34,365 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-779614672427365938_1155 size 22049
2013-10-31 18:34:34,365 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-779614672427365938_1155 size 22049
2013-10-31 18:34:34,372 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:34,372 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000000_0'
2013-10-31 18:34:34,373 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000003_0'
2013-10-31 18:34:34,373 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072395253391421232 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:34,373 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000004_0'
2013-10-31 18:34:34,373 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072395253391421232 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:34,373 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000005_0'
2013-10-31 18:34:34,374 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072395253391421232 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:34,377 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0014_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:34,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014	dst=null	perm=null
2013-10-31 18:34:34,382 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary
2013-10-31 18:34:34,384 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary
2013-10-31 18:34:34,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1	dst=null	perm=null
2013-10-31 18:34:34,405 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:34:34,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000	dst=null	perm=null
2013-10-31 18:34:34,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001	dst=null	perm=null
2013-10-31 18:34:34,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002	dst=null	perm=null
2013-10-31 18:34:34,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003	dst=null	perm=null
2013-10-31 18:34:34,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000	dst=null	perm=null
2013-10-31 18:34:34,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001	dst=null	perm=null
2013-10-31 18:34:34,415 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43338, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7675524486983705989_1146, duration: 300405
2013-10-31 18:34:34,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002	dst=null	perm=null
2013-10-31 18:34:34,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003	dst=null	perm=null
2013-10-31 18:34:34,426 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000001_0'
2013-10-31 18:34:34,426 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000002_0'
2013-10-31 18:34:34,434 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-9072395253391421232_1145 blk_6337612719236416595_1137 blk_6248130088879987270_1132 blk_-3748124066677778040_1142 blk_-6443718356478161979_1135
2013-10-31 18:34:34,435 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-9072395253391421232_1145
2013-10-31 18:34:34,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2	dst=null	perm=null
2013-10-31 18:34:34,437 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:34:34,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000	dst=null	perm=null
2013-10-31 18:34:34,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001	dst=null	perm=null
2013-10-31 18:34:34,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002	dst=null	perm=null
2013-10-31 18:34:34,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003	dst=null	perm=null
2013-10-31 18:34:34,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000	dst=null	perm=null
2013-10-31 18:34:34,444 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43339, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4210927453857164432_1148, duration: 281641
2013-10-31 18:34:34,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001	dst=null	perm=null
2013-10-31 18:34:34,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002	dst=null	perm=null
2013-10-31 18:34:34,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003	dst=null	perm=null
2013-10-31 18:34:34,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47514, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9191423163742438852_1153, duration: 142436
2013-10-31 18:34:34,448 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/split2
2013-10-31 18:34:34,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2	dst=null	perm=null
2013-10-31 18:34:34,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000	dst=null	perm=null
2013-10-31 18:34:34,454 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50144, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4210927453857164432_1148, duration: 118957
2013-10-31 18:34:34,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001	dst=null	perm=null
2013-10-31 18:34:34,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002	dst=null	perm=null
2013-10-31 18:34:34,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003	dst=null	perm=null
2013-10-31 18:34:34,461 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47516, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9191423163742438852_1153, duration: 109104
2013-10-31 18:34:34,461 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/split1
2013-10-31 18:34:34,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1	dst=null	perm=null
2013-10-31 18:34:34,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000	dst=null	perm=null
2013-10-31 18:34:34,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001	dst=null	perm=null
2013-10-31 18:34:34,472 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47234, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7675524486983705989_1146, duration: 269218
2013-10-31 18:34:34,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002	dst=null	perm=null
2013-10-31 18:34:34,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003	dst=null	perm=null
2013-10-31 18:34:34,496 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:34:34,497 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:34:34,516 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] starting
2013-10-31 18:34:34,517 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:34:34,517 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged"]
2013-10-31 18:34:34,518 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  parallel execution is enabled: true
2013-10-31 18:34:34,518 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  starting jobs: 2
2013-10-31 18:34:34,518 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  allocating threads: 2
2013-10-31 18:34:34,519 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (1/2)
2013-10-31 18:34:34,522 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:34,522 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:34:34,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:34,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:34:34,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:34,538 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar. blk_-6758522467386195759_1156
2013-10-31 18:34:34,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:50147 dest: /127.0.0.1:34578
2013-10-31 18:34:34,541 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:47236 dest: /127.0.0.1:37740
2013-10-31 18:34:34,543 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:47520 dest: /127.0.0.1:54365
2013-10-31 18:34:34,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47520, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6758522467386195759_1156, duration: 3744536
2013-10-31 18:34:34,551 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6758522467386195759_1156 terminating
2013-10-31 18:34:34,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47236, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6758522467386195759_1156, duration: 4639001
2013-10-31 18:34:34,552 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6758522467386195759_1156 terminating
2013-10-31 18:34:34,552 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50147, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6758522467386195759_1156, duration: 5617585
2013-10-31 18:34:34,553 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6758522467386195759_1156 terminating
2013-10-31 18:34:34,554 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:34,555 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:34,555 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:34,556 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:34,557 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:34,560 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar. New replication is 10
2013-10-31 18:34:34,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=null
2013-10-31 18:34:34,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,000 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:35,005 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:35,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:35,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,021 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split. New replication is 10
2013-10-31 18:34:35,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=null
2013-10-31 18:34:35,028 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split. blk_6399496362179302068_1157
2013-10-31 18:34:35,030 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:43347 dest: /127.0.0.1:59471
2013-10-31 18:34:35,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:47522 dest: /127.0.0.1:54365
2013-10-31 18:34:35,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:50152 dest: /127.0.0.1:34578
2013-10-31 18:34:35,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:47241 dest: /127.0.0.1:37740
2013-10-31 18:34:35,038 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47241, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6399496362179302068_1157, duration: 121326
2013-10-31 18:34:35,039 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,039 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50152, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6399496362179302068_1157, duration: 1017074
2013-10-31 18:34:35,040 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47522, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6399496362179302068_1157, duration: 2180010
2013-10-31 18:34:35,041 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,041 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43347, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6399496362179302068_1157, duration: 3015493
2013-10-31 18:34:35,041 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,043 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,043 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split from client DFSClient_-1596270109
2013-10-31 18:34:35,044 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:35,044 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,045 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,066 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo. blk_-3213097698103852867_1158
2013-10-31 18:34:35,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3213097698103852867_1158 src: /127.0.0.1:43351 dest: /127.0.0.1:59471
2013-10-31 18:34:35,069 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3213097698103852867_1158 src: /127.0.0.1:47526 dest: /127.0.0.1:54365
2013-10-31 18:34:35,071 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072395253391421232_1145 file build/test/data/dfs/data/data4/current/blk_-9072395253391421232 for deletion
2013-10-31 18:34:35,071 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data3/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:35,071 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072395253391421232_1145 at file build/test/data/dfs/data/data4/current/blk_-9072395253391421232
2013-10-31 18:34:35,071 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3748124066677778040_1142 file build/test/data/dfs/data/data3/current/blk_-3748124066677778040 for deletion
2013-10-31 18:34:35,071 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data3/current/blk_-6443718356478161979
2013-10-31 18:34:35,072 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data3/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:35,072 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3748124066677778040_1142 at file build/test/data/dfs/data/data3/current/blk_-3748124066677778040
2013-10-31 18:34:35,072 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6337612719236416595_1137 file build/test/data/dfs/data/data3/current/blk_6337612719236416595 for deletion
2013-10-31 18:34:35,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3213097698103852867_1158 src: /127.0.0.1:50156 dest: /127.0.0.1:34578
2013-10-31 18:34:35,073 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data3/current/blk_6248130088879987270
2013-10-31 18:34:35,073 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6337612719236416595_1137 at file build/test/data/dfs/data/data3/current/blk_6337612719236416595
2013-10-31 18:34:35,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50156, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3213097698103852867_1158, duration: 63430
2013-10-31 18:34:35,076 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3213097698103852867_1158 terminating
2013-10-31 18:34:35,077 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47526, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3213097698103852867_1158, duration: 852257
2013-10-31 18:34:35,077 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3213097698103852867_1158 terminating
2013-10-31 18:34:35,077 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3213097698103852867_1158 size 156
2013-10-31 18:34:35,077 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43351, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3213097698103852867_1158, duration: 1718046
2013-10-31 18:34:35,078 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3213097698103852867_1158 terminating
2013-10-31 18:34:35,082 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3213097698103852867_1158 size 156
2013-10-31 18:34:35,082 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:35,083 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:35,083 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3213097698103852867_1158 size 156
2013-10-31 18:34:35,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,108 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml. blk_7100172975871123190_1159
2013-10-31 18:34:35,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7100172975871123190_1159 src: /127.0.0.1:47245 dest: /127.0.0.1:37740
2013-10-31 18:34:35,112 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7100172975871123190_1159 src: /127.0.0.1:47529 dest: /127.0.0.1:54365
2013-10-31 18:34:35,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7100172975871123190_1159 src: /127.0.0.1:50159 dest: /127.0.0.1:34578
2013-10-31 18:34:35,116 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50159, dest: /127.0.0.1:34578, bytes: 27445, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 70132
2013-10-31 18:34:35,116 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7100172975871123190_1159 terminating
2013-10-31 18:34:35,117 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47529, dest: /127.0.0.1:54365, bytes: 27445, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7100172975871123190_1159, duration: 892568
2013-10-31 18:34:35,117 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7100172975871123190_1159 terminating
2013-10-31 18:34:35,118 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47245, dest: /127.0.0.1:37740, bytes: 27445, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7100172975871123190_1159, duration: 1749168
2013-10-31 18:34:35,118 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7100172975871123190_1159 terminating
2013-10-31 18:34:35,121 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7100172975871123190_1159 size 27445
2013-10-31 18:34:35,121 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:35,122 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:35,122 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7100172975871123190_1159 size 27445
2013-10-31 18:34:35,122 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7100172975871123190_1159 size 27445
2013-10-31 18:34:35,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=null
2013-10-31 18:34:35,137 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50161, bytes: 27661, op: HDFS_READ, cliID: DFSClient_2100615146, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 403775
2013-10-31 18:34:35,156 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0016: nMaps=4 nReduces=0 max=-1
2013-10-31 18:34:35,157 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0016 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:35,157 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0016
2013-10-31 18:34:35,157 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0016	RESULT=SUCCESS
2013-10-31 18:34:35,157 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0016
2013-10-31 18:34:35,159 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0016
2013-10-31 18:34:35,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,178 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml. blk_-6789407230370558946_1161
2013-10-31 18:34:35,180 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6789407230370558946_1161 src: /127.0.0.1:43359 dest: /127.0.0.1:59471
2013-10-31 18:34:35,181 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6789407230370558946_1161 src: /127.0.0.1:47534 dest: /127.0.0.1:54365
2013-10-31 18:34:35,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6789407230370558946_1161 src: /127.0.0.1:47252 dest: /127.0.0.1:37740
2013-10-31 18:34:35,187 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47252, dest: /127.0.0.1:37740, bytes: 27510, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6789407230370558946_1161, duration: 323816
2013-10-31 18:34:35,187 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6789407230370558946_1161 terminating
2013-10-31 18:34:35,187 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47534, dest: /127.0.0.1:54365, bytes: 27510, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6789407230370558946_1161, duration: 1179244
2013-10-31 18:34:35,188 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6789407230370558946_1161 terminating
2013-10-31 18:34:35,188 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43359, dest: /127.0.0.1:59471, bytes: 27510, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6789407230370558946_1161, duration: 2140226
2013-10-31 18:34:35,189 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6789407230370558946_1161 terminating
2013-10-31 18:34:35,192 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6789407230370558946_1161 size 27510
2013-10-31 18:34:35,193 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6789407230370558946_1161 size 27510
2013-10-31 18:34:35,193 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6789407230370558946_1161 size 27510
2013-10-31 18:34:35,593 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml from client DFSClient_2100615146
2013-10-31 18:34:35,593 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml is closed by DFSClient_2100615146
2013-10-31 18:34:35,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,605 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken. blk_3357374393869421348_1162
2013-10-31 18:34:35,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3357374393869421348_1162 src: /127.0.0.1:43362 dest: /127.0.0.1:59471
2013-10-31 18:34:35,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3357374393869421348_1162 src: /127.0.0.1:50166 dest: /127.0.0.1:34578
2013-10-31 18:34:35,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3357374393869421348_1162 src: /127.0.0.1:47538 dest: /127.0.0.1:54365
2013-10-31 18:34:35,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47538, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3357374393869421348_1162, duration: 72618
2013-10-31 18:34:35,614 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3357374393869421348_1162 terminating
2013-10-31 18:34:35,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50166, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3357374393869421348_1162, duration: 844008
2013-10-31 18:34:35,615 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3357374393869421348_1162 terminating
2013-10-31 18:34:35,615 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3357374393869421348_1162 size 116
2013-10-31 18:34:35,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43362, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3357374393869421348_1162, duration: 1735861
2013-10-31 18:34:35,616 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3357374393869421348_1162 size 116
2013-10-31 18:34:35,616 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3357374393869421348_1162 terminating
2013-10-31 18:34:35,618 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3357374393869421348_1162 size 116
2013-10-31 18:34:35,618 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:35,619 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:35,623 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken
2013-10-31 18:34:35,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:34:35,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50168, bytes: 160, op: HDFS_READ, cliID: DFSClient_2100615146, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3213097698103852867_1158, duration: 279127
2013-10-31 18:34:35,628 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0016 = 1449. Number of splits = 4
2013-10-31 18:34:35,629 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,629 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,629 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,629 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,632 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0016 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:35,632 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0016 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:34:36,269 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072395253391421232_1145 file build/test/data/dfs/data/data8/current/blk_-9072395253391421232 for deletion
2013-10-31 18:34:36,270 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072395253391421232_1145 at file build/test/data/dfs/data/data8/current/blk_-9072395253391421232
2013-10-31 18:34:36,423 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:36,423 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000000_0 not found in cache
2013-10-31 18:34:36,423 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000004_0 not found in cache
2013-10-31 18:34:36,423 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000001_0 not found in cache
2013-10-31 18:34:36,424 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383330876424
2013-10-31 18:34:36,424 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:36,425 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0014 being deleted.
2013-10-31 18:34:36,425 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:36,425 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000003_0 not found in cache
2013-10-31 18:34:36,426 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000002_0 not found in cache
2013-10-31 18:34:36,426 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383330876426
2013-10-31 18:34:36,426 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:36,427 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0014 being deleted.
2013-10-31 18:34:36,828 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_-773358262 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:36,839 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24614 with signal TERM. Exit code 0
2013-10-31 18:34:36,948 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_-699255952 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:36,955 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24613 with signal TERM. Exit code 0
2013-10-31 18:34:36,992 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_428164535 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:36,997 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24292 with signal TERM. Exit code 0
2013-10-31 18:34:37,052 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,052 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,052 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:37,053 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_-773358262 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:37,155 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,155 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,155 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:37,155 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_428164535 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:34:37,156 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,156 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,156 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:37,156 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_-699255952 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:37,225 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_-550848985 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:37,235 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24509 with signal TERM. Exit code 0
2013-10-31 18:34:37,379 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0016_m_000005_0' to tip task_20131031182606197_0016_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:37,385 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3135295757712174631_1031
2013-10-31 18:34:37,388 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:34:37,389 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000005_0 which needs 1 slots
2013-10-31 18:34:37,389 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000005_0 which needs 1 slots
2013-10-31 18:34:37,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken	dst=null	perm=null
2013-10-31 18:34:37,398 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50169, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3357374393869421348_1162, duration: 287552
2013-10-31 18:34:37,402 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,402 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,402 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:37,402 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_-550848985 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:34:37,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=null
2013-10-31 18:34:37,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47259, bytes: 27661, op: HDFS_READ, cliID: DFSClient_-1387558199, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7100172975871123190_1159, duration: 202167
2013-10-31 18:34:37,434 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:37,435 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-6758522467386195759_1156 to datanode(s) 127.0.0.1:59471
2013-10-31 18:34:37,436 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-9072395253391421232_1145
2013-10-31 18:34:37,436 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_6248130088879987270_1132 blk_-3748124066677778040_1142 blk_-7689919938199943373_1141 blk_-6443718356478161979_1135
2013-10-31 18:34:37,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=null
2013-10-31 18:34:37,468 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47543, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1387558199, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6758522467386195759_1156, duration: 1680870
2013-10-31 18:34:37,563 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0014_m_-838970058
2013-10-31 18:34:37,570 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24461 with signal TERM. Exit code 0
2013-10-31 18:34:37,570 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_386164469
2013-10-31 18:34:37,571 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_386164469 spawned.
2013-10-31 18:34:37,573 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000005_0/taskjvm.sh
2013-10-31 18:34:37,695 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,695 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,695 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:37,696 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_-838970058 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:38,801 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7689919938199943373_1141 file build/test/data/dfs/data/data5/current/blk_-7689919938199943373 for deletion
2013-10-31 18:34:38,801 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data6/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:38,802 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3748124066677778040_1142 file build/test/data/dfs/data/data6/current/blk_-3748124066677778040 for deletion
2013-10-31 18:34:38,802 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data6/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:38,841 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data6/current/blk_-6443718356478161979
2013-10-31 18:34:38,841 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7689919938199943373_1141 at file build/test/data/dfs/data/data5/current/blk_-7689919938199943373
2013-10-31 18:34:38,842 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3748124066677778040_1142 at file build/test/data/dfs/data/data6/current/blk_-3748124066677778040
2013-10-31 18:34:38,842 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data6/current/blk_6248130088879987270
2013-10-31 18:34:39,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072395253391421232_1145 file build/test/data/dfs/data/data2/current/blk_-9072395253391421232 for deletion
2013-10-31 18:34:39,197 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072395253391421232_1145 at file build/test/data/dfs/data/data2/current/blk_-9072395253391421232
2013-10-31 18:34:39,270 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-6758522467386195759_1156 to 127.0.0.1:59471 
2013-10-31 18:34:39,271 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:43370 dest: /127.0.0.1:59471
2013-10-31 18:34:39,271 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-6758522467386195759_1156 to /127.0.0.1:59471
2013-10-31 18:34:39,273 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-6758522467386195759_1156 src: /127.0.0.1:43370 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:34:39,274 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:39,374 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:39,375 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000004_0 not found in cache
2013-10-31 18:34:39,375 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000003_0 not found in cache
2013-10-31 18:34:39,375 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000000_0 not found in cache
2013-10-31 18:34:39,375 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383330879375
2013-10-31 18:34:39,375 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:39,376 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0015 being deleted.
2013-10-31 18:34:39,427 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:39,427 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000002_0 not found in cache
2013-10-31 18:34:39,427 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000001_0 not found in cache
2013-10-31 18:34:39,427 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383330879427
2013-10-31 18:34:39,650 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_386164469 given task: attempt_20131031182606197_0016_m_000005_0
2013-10-31 18:34:39,831 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0014_m_1010098939 since job job_20131031182606197_0014 is dead
2013-10-31 18:34:39,836 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24554 with signal TERM. Exit code 0
2013-10-31 18:34:39,843 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0014_m_-1312562418 since job job_20131031182606197_0014 is dead
2013-10-31 18:34:39,847 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24553 with signal TERM. Exit code 0
2013-10-31 18:34:40,043 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:40,044 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:40,044 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:40,044 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_-1312562418 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:40,052 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:40,052 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:40,052 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:40,053 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_1010098939 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:40,111 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0014_m_-251095346 since job job_20131031182606197_0014 is dead
2013-10-31 18:34:40,120 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24262 with signal TERM. Exit code 0
2013-10-31 18:34:40,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:40,282 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:40,282 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:40,283 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:34:40,283 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_-251095346 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:34:43,121 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000005_0 0.0% setup
2013-10-31 18:34:43,125 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000005_0 is done.
2013-10-31 18:34:43,125 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000005_0  was -1
2013-10-31 18:34:43,125 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:43,393 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000005_0' has completed task_20131031182606197_0016_m_000005 successfully.
2013-10-31 18:34:43,396 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000000_0' to tip task_20131031182606197_0016_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:43,397 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000000
2013-10-31 18:34:43,399 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:34:43,400 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000000_0 which needs 1 slots
2013-10-31 18:34:43,400 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000000_0 which needs 1 slots
2013-10-31 18:34:43,430 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_1092332295
2013-10-31 18:34:43,430 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_1092332295 spawned.
2013-10-31 18:34:43,432 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000000_0/taskjvm.sh
2013-10-31 18:34:43,433 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000001_0' to tip task_20131031182606197_0016_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:43,433 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000001
2013-10-31 18:34:43,434 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000002_0' to tip task_20131031182606197_0016_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:43,434 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:43,434 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000002
2013-10-31 18:34:43,434 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000001_0 which needs 1 slots
2013-10-31 18:34:43,434 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000001_0 which needs 1 slots
2013-10-31 18:34:43,435 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000003_0' to tip task_20131031182606197_0016_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:43,435 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000003
2013-10-31 18:34:43,435 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:34:43,435 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000002_0 which needs 1 slots
2013-10-31 18:34:43,436 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000002_0 which needs 1 slots
2013-10-31 18:34:43,436 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:34:43,437 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000003_0 which needs 1 slots
2013-10-31 18:34:43,437 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000003_0 which needs 1 slots
2013-10-31 18:34:43,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken	dst=null	perm=null
2013-10-31 18:34:43,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken	dst=null	perm=null
2013-10-31 18:34:43,444 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43375, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3357374393869421348_1162, duration: 303720
2013-10-31 18:34:43,444 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43374, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3357374393869421348_1162, duration: 289913
2013-10-31 18:34:43,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=null
2013-10-31 18:34:43,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=null
2013-10-31 18:34:43,457 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50181, bytes: 27661, op: HDFS_READ, cliID: DFSClient_1444728494, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 390518
2013-10-31 18:34:43,457 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50182, bytes: 27661, op: HDFS_READ, cliID: DFSClient_-173508879, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 404911
2013-10-31 18:34:43,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken	dst=null	perm=null
2013-10-31 18:34:43,483 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47554, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3357374393869421348_1162, duration: 260212
2013-10-31 18:34:43,486 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:43,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml	dst=null	perm=null
2013-10-31 18:34:43,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50185, bytes: 27661, op: HDFS_READ, cliID: DFSClient_2042374937, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 190214
2013-10-31 18:34:43,504 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:43,514 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:43,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=null
2013-10-31 18:34:43,519 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43383, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-173508879, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6758522467386195759_1156, duration: 1432319
2013-10-31 18:34:43,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=null
2013-10-31 18:34:43,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar	dst=null	perm=null
2013-10-31 18:34:43,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47275, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1444728494, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6758522467386195759_1156, duration: 636787
2013-10-31 18:34:43,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47276, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2042374937, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6758522467386195759_1156, duration: 679386
2013-10-31 18:34:43,820 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_91562867
2013-10-31 18:34:43,821 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_2027104624
2013-10-31 18:34:43,822 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_91562867 spawned.
2013-10-31 18:34:43,821 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_-1174497248
2013-10-31 18:34:43,823 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_2027104624 spawned.
2013-10-31 18:34:43,825 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_-1174497248 spawned.
2013-10-31 18:34:43,828 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000001_0/taskjvm.sh
2013-10-31 18:34:43,828 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000003_0/taskjvm.sh
2013-10-31 18:34:43,829 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000002_0/taskjvm.sh
2013-10-31 18:34:45,438 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_1092332295 given task: attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:45,444 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_2027104624 given task: attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:45,445 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_-1174497248 given task: attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:45,450 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_91562867 given task: attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:45,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=null
2013-10-31 18:34:45,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=null
2013-10-31 18:34:45,942 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47568, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6399496362179302068_1157, duration: 171057
2013-10-31 18:34:45,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=null
2013-10-31 18:34:45,947 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47569, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6399496362179302068_1157, duration: 170981
2013-10-31 18:34:45,951 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47287, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6399496362179302068_1157, duration: 141356
2013-10-31 18:34:45,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split	dst=null	perm=null
2013-10-31 18:34:45,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47288, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6399496362179302068_1157, duration: 105976
2013-10-31 18:34:45,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:45,981 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47572, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 108880
2013-10-31 18:34:45,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:45,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:45,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47290, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 146225
2013-10-31 18:34:45,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:34:45,997 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50203, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 168400
2013-10-31 18:34:46,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50204, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 201780
2013-10-31 18:34:46,560 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000. blk_8795753558913403673_1166
2013-10-31 18:34:46,561 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002. blk_9090210315426494664_1166
2013-10-31 18:34:46,561 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003. blk_-4627257443058578093_1166
2013-10-31 18:34:46,563 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001. blk_-9072667424849248381_1166
2013-10-31 18:34:46,586 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4627257443058578093_1166 src: /127.0.0.1:47295 dest: /127.0.0.1:37740
2013-10-31 18:34:46,587 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4627257443058578093_1166 src: /127.0.0.1:47580 dest: /127.0.0.1:54365
2013-10-31 18:34:46,587 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072667424849248381_1166 src: /127.0.0.1:47296 dest: /127.0.0.1:37740
2013-10-31 18:34:46,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072667424849248381_1166 src: /127.0.0.1:43408 dest: /127.0.0.1:59471
2013-10-31 18:34:46,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4627257443058578093_1166 src: /127.0.0.1:43407 dest: /127.0.0.1:59471
2013-10-31 18:34:46,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072667424849248381_1166 src: /127.0.0.1:47583 dest: /127.0.0.1:54365
2013-10-31 18:34:46,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9090210315426494664_1166 src: /127.0.0.1:47577 dest: /127.0.0.1:54365
2013-10-31 18:34:46,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47583, dest: /127.0.0.1:54365, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9072667424849248381_1166, duration: 225425
2013-10-31 18:34:46,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9090210315426494664_1166 src: /127.0.0.1:47301 dest: /127.0.0.1:37740
2013-10-31 18:34:46,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43407, dest: /127.0.0.1:59471, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4627257443058578093_1166, duration: 2643600
2013-10-31 18:34:46,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43408, dest: /127.0.0.1:59471, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9072667424849248381_1166, duration: 633726
2013-10-31 18:34:46,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4627257443058578093_1166 terminating
2013-10-31 18:34:46,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9072667424849248381_1166 terminating
2013-10-31 18:34:46,593 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9072667424849248381_1166 terminating
2013-10-31 18:34:46,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4627257443058578093_1166 size 264
2013-10-31 18:34:46,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9090210315426494664_1166 src: /127.0.0.1:50214 dest: /127.0.0.1:34578
2013-10-31 18:34:46,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8795753558913403673_1166 src: /127.0.0.1:47576 dest: /127.0.0.1:54365
2013-10-31 18:34:46,595 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47296, dest: /127.0.0.1:37740, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072667424849248381_1166, duration: 3206844
2013-10-31 18:34:46,595 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9072667424849248381_1166 size 217
2013-10-31 18:34:46,596 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9072667424849248381_1166 terminating
2013-10-31 18:34:46,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47580, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4627257443058578093_1166, duration: 2169314
2013-10-31 18:34:46,598 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8795753558913403673_1166 src: /127.0.0.1:50215 dest: /127.0.0.1:34578
2013-10-31 18:34:46,599 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4627257443058578093_1166 terminating
2013-10-31 18:34:46,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50214, dest: /127.0.0.1:34578, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9090210315426494664_1166, duration: 891321
2013-10-31 18:34:46,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47295, dest: /127.0.0.1:37740, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4627257443058578093_1166, duration: 10689217
2013-10-31 18:34:46,598 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9072667424849248381_1166 size 217
2013-10-31 18:34:46,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47301, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9090210315426494664_1166, duration: 2089921
2013-10-31 18:34:46,601 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:46,601 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9090210315426494664_1166 terminating
2013-10-31 18:34:46,600 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4627257443058578093_1166 terminating
2013-10-31 18:34:46,601 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47577, dest: /127.0.0.1:54365, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9090210315426494664_1166, duration: 2766644
2013-10-31 18:34:46,600 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9090210315426494664_1166 terminating
2013-10-31 18:34:46,601 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9090210315426494664_1166 terminating
2013-10-31 18:34:46,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:46,601 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8795753558913403673_1166 src: /127.0.0.1:47304 dest: /127.0.0.1:37740
2013-10-31 18:34:46,602 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:46,602 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:46,602 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9072667424849248381_1166 size 217
2013-10-31 18:34:46,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4627257443058578093_1166 size 264
2013-10-31 18:34:46,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4627257443058578093_1166 size 264
2013-10-31 18:34:46,603 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9090210315426494664_1166 size 70
2013-10-31 18:34:46,604 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9090210315426494664_1166 size 70
2013-10-31 18:34:46,604 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9090210315426494664_1166 size 70
2013-10-31 18:34:46,605 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47304, dest: /127.0.0.1:37740, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8795753558913403673_1166, duration: 1096360
2013-10-31 18:34:46,605 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8795753558913403673_1166 terminating
2013-10-31 18:34:46,605 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50215, dest: /127.0.0.1:34578, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8795753558913403673_1166, duration: 1473579
2013-10-31 18:34:46,605 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8795753558913403673_1166 terminating
2013-10-31 18:34:46,606 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47576, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8795753558913403673_1166, duration: 1856587
2013-10-31 18:34:46,606 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8795753558913403673_1166 terminating
2013-10-31 18:34:46,608 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8795753558913403673_1166 size 264
2013-10-31 18:34:46,608 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8795753558913403673_1166 size 264
2013-10-31 18:34:46,609 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8795753558913403673_1166 size 264
2013-10-31 18:34:46,648 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:46,648 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000001_0 0.0% 
2013-10-31 18:34:46,657 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:46,657 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000003_0 0.0% 
2013-10-31 18:34:47,004 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:47,005 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:47,008 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:47,008 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:47,069 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:47,069 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000002_0 0.0% 
2013-10-31 18:34:47,076 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:47,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000000_0 0.0% 
2013-10-31 18:34:48,400 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0016_m_000005_0
2013-10-31 18:34:48,400 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0016_m_000005_0
2013-10-31 18:34:48,401 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000005_0 not found in cache
2013-10-31 18:34:49,404 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:49,439 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:49,441 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:49,441 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:49,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0	dst=null	perm=null
2013-10-31 18:34:49,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:49,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0	dst=null	perm=null
2013-10-31 18:34:49,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:49,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:49,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0	dst=null	perm=null
2013-10-31 18:34:49,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:49,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0	dst=null	perm=null
2013-10-31 18:34:50,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0	dst=null	perm=null
2013-10-31 18:34:50,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:50,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0	dst=null	perm=null
2013-10-31 18:34:50,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:50,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:50,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:50,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0	dst=null	perm=null
2013-10-31 18:34:50,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0	dst=null	perm=null
2013-10-31 18:34:51,919 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:51,921 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:51,921 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000000_0 is done.
2013-10-31 18:34:51,921 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000000_0  was -1
2013-10-31 18:34:51,921 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:51,921 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:51,923 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:51,924 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000001_0 is done.
2013-10-31 18:34:51,924 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000001_0  was -1
2013-10-31 18:34:51,924 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:51,934 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:51,936 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:51,937 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000002_0 is done.
2013-10-31 18:34:51,937 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000002_0  was -1
2013-10-31 18:34:51,937 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:51,937 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:51,939 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:51,940 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000003_0 is done.
2013-10-31 18:34:51,940 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000003_0  was -1
2013-10-31 18:34:51,940 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:52,408 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000000_0' has completed task_20131031182606197_0016_m_000000 successfully.
2013-10-31 18:34:52,443 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000001_0' has completed task_20131031182606197_0016_m_000001 successfully.
2013-10-31 18:34:52,446 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000003_0' has completed task_20131031182606197_0016_m_000003 successfully.
2013-10-31 18:34:52,448 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000002_0' has completed task_20131031182606197_0016_m_000002 successfully.
2013-10-31 18:34:52,451 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0016_m_000004_0' to tip task_20131031182606197_0016_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:52,488 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:34:52,489 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000004_0 which needs 1 slots
2013-10-31 18:34:52,489 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000004_0 which needs 1 slots
2013-10-31 18:34:52,525 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_528033224
2013-10-31 18:34:52,526 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_528033224 spawned.
2013-10-31 18:34:52,528 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000004_0/taskjvm.sh
2013-10-31 18:34:53,370 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_528033224 given task: attempt_20131031182606197_0016_m_000004_0
2013-10-31 18:34:53,907 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000004_0 0.0% 
2013-10-31 18:34:53,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary	dst=null	perm=null
2013-10-31 18:34:54,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:54,021 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_SUCCESS from client DFSClient_attempt_20131031182606197_0016_m_000004_0
2013-10-31 18:34:54,022 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0016_m_000004_0
2013-10-31 18:34:54,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,029 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,029 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:54,029 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:54,029 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:54,030 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,030 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:54,030 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,030 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3213097698103852867 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,031 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3213097698103852867 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:54,031 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3213097698103852867 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,031 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7100172975871123190 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:54,031 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7100172975871123190 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,032 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7100172975871123190 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016	dst=null	perm=null
2013-10-31 18:34:55,439 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_7100172975871123190_1159 blk_-3213097698103852867_1158 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:55,440 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_7100172975871123190_1159 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:34:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,033 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,038 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,043 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,049 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,049 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:34:56,819 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000004_0 0.0% cleanup
2013-10-31 18:34:56,820 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000004_0 is done.
2013-10-31 18:34:56,821 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000004_0  was -1
2013-10-31 18:34:56,821 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:57,204 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data2/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:57,204 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3213097698103852867_1158 file build/test/data/dfs/data/data2/current/blk_-3213097698103852867 for deletion
2013-10-31 18:34:57,204 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data2/current/blk_-6758522467386195759
2013-10-31 18:34:57,204 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data1/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:57,205 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3213097698103852867_1158 at file build/test/data/dfs/data/data2/current/blk_-3213097698103852867
2013-10-31 18:34:57,205 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7100172975871123190_1159 file build/test/data/dfs/data/data1/current/blk_7100172975871123190 for deletion
2013-10-31 18:34:57,205 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data1/current/blk_6399496362179302068
2013-10-31 18:34:57,206 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7100172975871123190_1159 at file build/test/data/dfs/data/data1/current/blk_7100172975871123190
2013-10-31 18:34:57,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data7/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:57,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data8/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:57,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data7/current/blk_-6758522467386195759
2013-10-31 18:34:57,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data8/current/blk_6399496362179302068
2013-10-31 18:34:57,277 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7100172975871123190_1159 file build/test/data/dfs/data/data7/current/blk_7100172975871123190 for deletion
2013-10-31 18:34:57,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7100172975871123190_1159 at file build/test/data/dfs/data/data7/current/blk_7100172975871123190
2013-10-31 18:34:58,440 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_7100172975871123190_1159 blk_-3213097698103852867_1158 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:58,440 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-3213097698103852867_1158 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:58,496 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000004_0' has completed task_20131031182606197_0016_m_000004 successfully.
2013-10-31 18:34:58,497 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0016 has completed successfully.
2013-10-31 18:34:58,497 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0016,submitTime=1383244475128,launchTime=1383244475632,firstMapTaskLaunchTime=1383244483396,firstJobSetupTaskLaunchTime=1383244477378,firstJobCleanupTaskLaunchTime=1383244492451,finishTime=1383244498497,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=43,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D04322ECDC9F4E7281BF003BCAE07C61/69BDD30D16B646CC9BA938D95DF4A337] merged/(1/2)
2013-10-31 18:34:58,506 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC. blk_2087420957165246899_1167
2013-10-31 18:34:58,508 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2087420957165246899_1167 src: /127.0.0.1:43418 dest: /127.0.0.1:59471
2013-10-31 18:34:58,510 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2087420957165246899_1167 src: /127.0.0.1:47593 dest: /127.0.0.1:54365
2013-10-31 18:34:58,512 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2087420957165246899_1167 src: /127.0.0.1:47311 dest: /127.0.0.1:37740
2013-10-31 18:34:58,521 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47311, dest: /127.0.0.1:37740, bytes: 22429, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2087420957165246899_1167, duration: 4835298
2013-10-31 18:34:58,522 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2087420957165246899_1167 terminating
2013-10-31 18:34:58,522 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47593, dest: /127.0.0.1:54365, bytes: 22429, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2087420957165246899_1167, duration: 5488386
2013-10-31 18:34:58,522 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2087420957165246899_1167 size 22429
2013-10-31 18:34:58,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2087420957165246899_1167 terminating
2013-10-31 18:34:58,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43418, dest: /127.0.0.1:59471, bytes: 22429, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2087420957165246899_1167, duration: 7226611
2013-10-31 18:34:58,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2087420957165246899_1167 terminating
2013-10-31 18:34:58,527 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC from client DFSClient_2100615146
2013-10-31 18:34:58,527 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC is closed by DFSClient_2100615146
2013-10-31 18:34:58,527 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2087420957165246899_1167 size 22429
2013-10-31 18:34:58,528 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2087420957165246899_1167 size 22429
2013-10-31 18:34:58,535 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:58,537 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000002_0'
2013-10-31 18:34:58,537 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000004_0'
2013-10-31 18:34:58,537 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3357374393869421348 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:58,539 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3357374393869421348 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:58,539 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3357374393869421348 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:58,539 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0016_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:58,543 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (2/2) ...latform/splitsourcemerged
2013-10-31 18:34:58,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016	dst=null	perm=null
2013-10-31 18:34:58,547 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:58,547 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:34:58,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:58,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:34:58,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,569 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar. blk_-1767724206513468299_1168
2013-10-31 18:34:58,571 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:43422 dest: /127.0.0.1:59471
2013-10-31 18:34:58,573 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:47597 dest: /127.0.0.1:54365
2013-10-31 18:34:58,574 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:50227 dest: /127.0.0.1:34578
2013-10-31 18:34:58,589 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50227, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1767724206513468299_1168, duration: 11883355
2013-10-31 18:34:58,590 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1767724206513468299_1168 terminating
2013-10-31 18:34:58,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47597, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1767724206513468299_1168, duration: 12649974
2013-10-31 18:34:58,591 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1767724206513468299_1168 terminating
2013-10-31 18:34:58,591 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43422, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1767724206513468299_1168, duration: 13692930
2013-10-31 18:34:58,592 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1767724206513468299_1168 terminating
2013-10-31 18:34:58,593 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:34:58,594 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:58,594 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:58,594 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:34:58,595 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:34:58,600 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar. New replication is 10
2013-10-31 18:34:58,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=null
2013-10-31 18:34:58,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,611 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:58,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C	dst=null	perm=null
2013-10-31 18:34:58,616 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:34:58,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000	dst=null	perm=null
2013-10-31 18:34:58,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001	dst=null	perm=null
2013-10-31 18:34:58,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002	dst=null	perm=null
2013-10-31 18:34:58,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003	dst=null	perm=null
2013-10-31 18:34:58,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,634 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split. New replication is 10
2013-10-31 18:34:58,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=null
2013-10-31 18:34:58,641 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split. blk_4501709775066199659_1169
2013-10-31 18:34:58,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:47316 dest: /127.0.0.1:37740
2013-10-31 18:34:58,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:43426 dest: /127.0.0.1:59471
2013-10-31 18:34:58,646 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:50230 dest: /127.0.0.1:34578
2013-10-31 18:34:58,647 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:47602 dest: /127.0.0.1:54365
2013-10-31 18:34:58,651 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47602, dest: /127.0.0.1:54365, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 98728
2013-10-31 18:34:58,652 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,652 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50230, dest: /127.0.0.1:34578, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4501709775066199659_1169, duration: 928134
2013-10-31 18:34:58,653 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,653 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43426, dest: /127.0.0.1:59471, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4501709775066199659_1169, duration: 1925262
2013-10-31 18:34:58,653 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,654 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47316, dest: /127.0.0.1:37740, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4501709775066199659_1169, duration: 2742555
2013-10-31 18:34:58,654 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,654 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,658 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,659 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split from client DFSClient_-1596270109
2013-10-31 18:34:58,659 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:58,660 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,660 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,678 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo. blk_3023221613854610402_1170
2013-10-31 18:34:58,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023221613854610402_1170 src: /127.0.0.1:47603 dest: /127.0.0.1:54365
2013-10-31 18:34:58,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023221613854610402_1170 src: /127.0.0.1:50233 dest: /127.0.0.1:34578
2013-10-31 18:34:58,683 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023221613854610402_1170 src: /127.0.0.1:43431 dest: /127.0.0.1:59471
2013-10-31 18:34:58,686 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43431, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3023221613854610402_1170, duration: 66389
2013-10-31 18:34:58,686 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3023221613854610402_1170 terminating
2013-10-31 18:34:58,687 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50233, dest: /127.0.0.1:34578, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3023221613854610402_1170, duration: 857793
2013-10-31 18:34:58,687 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3023221613854610402_1170 terminating
2013-10-31 18:34:58,688 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3023221613854610402_1170 size 153
2013-10-31 18:34:58,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47603, dest: /127.0.0.1:54365, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3023221613854610402_1170, duration: 1876745
2013-10-31 18:34:58,688 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3023221613854610402_1170 size 153
2013-10-31 18:34:58,688 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3023221613854610402_1170 terminating
2013-10-31 18:34:58,691 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3023221613854610402_1170 size 153
2013-10-31 18:34:58,692 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:58,693 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:58,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,717 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml. blk_4560125798104689975_1171
2013-10-31 18:34:58,718 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4560125798104689975_1171 src: /127.0.0.1:50235 dest: /127.0.0.1:34578
2013-10-31 18:34:58,720 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4560125798104689975_1171 src: /127.0.0.1:47324 dest: /127.0.0.1:37740
2013-10-31 18:34:58,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4560125798104689975_1171 src: /127.0.0.1:47608 dest: /127.0.0.1:54365
2013-10-31 18:34:58,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47608, dest: /127.0.0.1:54365, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4560125798104689975_1171, duration: 355449
2013-10-31 18:34:58,725 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4560125798104689975_1171 terminating
2013-10-31 18:34:58,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47324, dest: /127.0.0.1:37740, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 1194467
2013-10-31 18:34:58,726 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4560125798104689975_1171 terminating
2013-10-31 18:34:58,726 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4560125798104689975_1171 size 28310
2013-10-31 18:34:58,726 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50235, dest: /127.0.0.1:34578, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4560125798104689975_1171, duration: 2073696
2013-10-31 18:34:58,727 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4560125798104689975_1171 size 28310
2013-10-31 18:34:58,727 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4560125798104689975_1171 terminating
2013-10-31 18:34:58,729 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:58,730 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:58,731 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4560125798104689975_1171 size 28310
2013-10-31 18:34:59,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data3/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:59,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3213097698103852867_1158 file build/test/data/dfs/data/data3/current/blk_-3213097698103852867 for deletion
2013-10-31 18:34:59,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data3/current/blk_-6758522467386195759
2013-10-31 18:34:59,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data4/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:59,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3213097698103852867_1158 at file build/test/data/dfs/data/data3/current/blk_-3213097698103852867
2013-10-31 18:34:59,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7100172975871123190_1159 file build/test/data/dfs/data/data4/current/blk_7100172975871123190 for deletion
2013-10-31 18:34:59,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data4/current/blk_6399496362179302068
2013-10-31 18:34:59,081 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7100172975871123190_1159 at file build/test/data/dfs/data/data4/current/blk_7100172975871123190
2013-10-31 18:34:59,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=null
2013-10-31 18:34:59,468 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50239, bytes: 28534, op: HDFS_READ, cliID: DFSClient_-620184378, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4560125798104689975_1171, duration: 410963
2013-10-31 18:34:59,483 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0017: nMaps=4 nReduces=1 max=-1
2013-10-31 18:34:59,483 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0017 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:59,484 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0017	RESULT=SUCCESS
2013-10-31 18:34:59,484 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0017
2013-10-31 18:34:59,484 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0017
2013-10-31 18:34:59,484 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0017
2013-10-31 18:34:59,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:59,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:59,510 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml. blk_-2582993331910526702_1173
2013-10-31 18:34:59,512 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2582993331910526702_1173 src: /127.0.0.1:43437 dest: /127.0.0.1:59471
2013-10-31 18:34:59,513 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2582993331910526702_1173 src: /127.0.0.1:50241 dest: /127.0.0.1:34578
2013-10-31 18:34:59,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2582993331910526702_1173 src: /127.0.0.1:47330 dest: /127.0.0.1:37740
2013-10-31 18:34:59,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47330, dest: /127.0.0.1:37740, bytes: 28375, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2582993331910526702_1173, duration: 609252
2013-10-31 18:34:59,519 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2582993331910526702_1173 terminating
2013-10-31 18:34:59,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50241, dest: /127.0.0.1:34578, bytes: 28375, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2582993331910526702_1173, duration: 1040557
2013-10-31 18:34:59,520 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2582993331910526702_1173 terminating
2013-10-31 18:34:59,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43437, dest: /127.0.0.1:59471, bytes: 28375, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2582993331910526702_1173, duration: 1863139
2013-10-31 18:34:59,521 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2582993331910526702_1173 terminating
2013-10-31 18:34:59,522 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2582993331910526702_1173 size 28375
2013-10-31 18:34:59,523 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2582993331910526702_1173 size 28375
2013-10-31 18:34:59,524 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2582993331910526702_1173 size 28375
2013-10-31 18:34:59,808 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data6/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:59,808 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3213097698103852867_1158 file build/test/data/dfs/data/data5/current/blk_-3213097698103852867 for deletion
2013-10-31 18:34:59,808 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data6/current/blk_-6758522467386195759
2013-10-31 18:34:59,808 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data6/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:59,808 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3213097698103852867_1158 at file build/test/data/dfs/data/data5/current/blk_-3213097698103852867
2013-10-31 18:34:59,809 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data6/current/blk_6399496362179302068
2013-10-31 18:34:59,922 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml from client DFSClient_-620184378
2013-10-31 18:34:59,923 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml is closed by DFSClient_-620184378
2013-10-31 18:34:59,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:59,937 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken. blk_5683982942081372135_1174
2013-10-31 18:34:59,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5683982942081372135_1174 src: /127.0.0.1:50243 dest: /127.0.0.1:34578
2013-10-31 18:34:59,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5683982942081372135_1174 src: /127.0.0.1:47332 dest: /127.0.0.1:37740
2013-10-31 18:34:59,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5683982942081372135_1174 src: /127.0.0.1:43442 dest: /127.0.0.1:59471
2013-10-31 18:34:59,946 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43442, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5683982942081372135_1174, duration: 87959
2013-10-31 18:34:59,947 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5683982942081372135_1174 terminating
2013-10-31 18:34:59,947 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47332, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5683982942081372135_1174, duration: 1147507
2013-10-31 18:34:59,947 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5683982942081372135_1174 terminating
2013-10-31 18:34:59,948 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50243, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5683982942081372135_1174, duration: 2017936
2013-10-31 18:34:59,948 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5683982942081372135_1174 size 116
2013-10-31 18:34:59,949 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5683982942081372135_1174 terminating
2013-10-31 18:34:59,952 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5683982942081372135_1174 size 116
2013-10-31 18:34:59,953 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:59,953 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:59,954 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5683982942081372135_1174 size 116
2013-10-31 18:34:59,958 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken
2013-10-31 18:34:59,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:34:59,963 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43443, bytes: 157, op: HDFS_READ, cliID: DFSClient_-620184378, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3023221613854610402_1170, duration: 349669
2013-10-31 18:34:59,964 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0017 = 815. Number of splits = 4
2013-10-31 18:34:59,964 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,964 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,967 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,967 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,967 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0017 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:59,968 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0017 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:35:01,422 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0017_m_000005_0' to tip task_20131031182606197_0017_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:01,427 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000000_0'
2013-10-31 18:35:01,427 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000005_0'
2013-10-31 18:35:01,429 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:35:01,429 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000005_0 which needs 1 slots
2013-10-31 18:35:01,429 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000005_0 which needs 1 slots
2013-10-31 18:35:01,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken	dst=null	perm=null
2013-10-31 18:35:01,438 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50247, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5683982942081372135_1174, duration: 322189
2013-10-31 18:35:01,442 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-1767724206513468299_1168 to datanode(s) 127.0.0.1:37740
2013-10-31 18:35:01,442 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_3357374393869421348_1162
2013-10-31 18:35:01,443 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_3357374393869421348_1162
2013-10-31 18:35:01,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=null
2013-10-31 18:35:01,449 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47337, bytes: 28534, op: HDFS_READ, cliID: DFSClient_233648399, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 389921
2013-10-31 18:35:01,456 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000001_0'
2013-10-31 18:35:01,458 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000003_0'
2013-10-31 18:35:01,481 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:01,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=null
2013-10-31 18:35:01,512 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50250, bytes: 239915, op: HDFS_READ, cliID: DFSClient_233648399, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1767724206513468299_1168, duration: 1235120
2013-10-31 18:35:01,592 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0016_m_1092332295
2013-10-31 18:35:01,599 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25282 with signal TERM. Exit code 0
2013-10-31 18:35:01,600 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_-371996203
2013-10-31 18:35:01,603 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_-371996203 spawned.
2013-10-31 18:35:01,605 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000005_0/taskjvm.sh
2013-10-31 18:35:01,675 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:01,675 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:01,675 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:01,676 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_1092332295 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:02,079 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3357374393869421348_1162 file build/test/data/dfs/data/data4/current/blk_3357374393869421348 for deletion
2013-10-31 18:35:02,080 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3357374393869421348_1162 at file build/test/data/dfs/data/data4/current/blk_3357374393869421348
2013-10-31 18:35:02,831 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_-371996203 given task: attempt_20131031182606197_0017_m_000005_0
2013-10-31 18:35:03,205 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-1767724206513468299_1168 to 127.0.0.1:37740 
2013-10-31 18:35:03,206 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3357374393869421348_1162 file build/test/data/dfs/data/data2/current/blk_3357374393869421348 for deletion
2013-10-31 18:35:03,206 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3357374393869421348_1162 at file build/test/data/dfs/data/data2/current/blk_3357374393869421348
2013-10-31 18:35:03,206 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:47340 dest: /127.0.0.1:37740
2013-10-31 18:35:03,206 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-1767724206513468299_1168 to /127.0.0.1:37740
2013-10-31 18:35:03,208 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1767724206513468299_1168 src: /127.0.0.1:47340 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:35:03,211 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:35:03,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:03,538 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:03,538 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000004_0 not found in cache
2013-10-31 18:35:03,538 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000002_0 not found in cache
2013-10-31 18:35:03,539 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330903539
2013-10-31 18:35:04,443 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_3357374393869421348_1162
2013-10-31 18:35:04,465 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_-1174497248 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:04,476 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25287 with signal TERM. Exit code 0
2013-10-31 18:35:04,681 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:04,681 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:04,681 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:04,681 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_-1174497248 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:04,885 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_528033224 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:04,895 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25558 with signal TERM. Exit code 0
2013-10-31 18:35:05,067 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:05,067 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:05,067 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:05,067 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_528033224 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:05,810 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3357374393869421348_1162 file build/test/data/dfs/data/data5/current/blk_3357374393869421348 for deletion
2013-10-31 18:35:05,811 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3357374393869421348_1162 at file build/test/data/dfs/data/data5/current/blk_3357374393869421348
2013-10-31 18:35:06,258 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000005_0 0.0% setup
2013-10-31 18:35:06,261 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000005_0 is done.
2013-10-31 18:35:06,261 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000005_0  was -1
2013-10-31 18:35:06,261 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:06,429 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:06,430 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000000_0 not found in cache
2013-10-31 18:35:06,430 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330906430
2013-10-31 18:35:06,456 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:06,456 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000001_0 not found in cache
2013-10-31 18:35:06,457 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330906457
2013-10-31 18:35:06,459 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:06,459 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000003_0 not found in cache
2013-10-31 18:35:06,460 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330906460
2013-10-31 18:35:06,630 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_386164469 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:06,638 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25106 with signal TERM. Exit code 0
2013-10-31 18:35:06,879 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:06,879 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:06,879 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:06,879 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_386164469 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:07,435 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000005_0' has completed task_20131031182606197_0017_m_000005 successfully.
2013-10-31 18:35:07,439 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000000_0' to tip task_20131031182606197_0017_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:07,457 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000000
2013-10-31 18:35:07,459 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:35:07,460 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000000_0 which needs 1 slots
2013-10-31 18:35:07,460 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000000_0 which needs 1 slots
2013-10-31 18:35:07,462 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_91562867 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:07,467 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000001_0' to tip task_20131031182606197_0017_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:35:07,468 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000001
2013-10-31 18:35:07,468 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25285 with signal TERM. Exit code 0
2013-10-31 18:35:07,470 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:35:07,470 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000002_0' to tip task_20131031182606197_0017_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:35:07,470 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000001_0 which needs 1 slots
2013-10-31 18:35:07,471 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000002
2013-10-31 18:35:07,471 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000001_0 which needs 1 slots
2013-10-31 18:35:07,472 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:35:07,473 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_2027104624 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:07,473 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000002_0 which needs 1 slots
2013-10-31 18:35:07,474 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000002_0 which needs 1 slots
2013-10-31 18:35:07,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken	dst=null	perm=null
2013-10-31 18:35:07,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken	dst=null	perm=null
2013-10-31 18:35:07,480 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25286 with signal TERM. Exit code 0
2013-10-31 18:35:07,480 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43451, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5683982942081372135_1174, duration: 598456
2013-10-31 18:35:07,489 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50255, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5683982942081372135_1174, duration: 127062
2013-10-31 18:35:07,489 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_204403117
2013-10-31 18:35:07,490 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_204403117 spawned.
2013-10-31 18:35:07,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=null
2013-10-31 18:35:07,492 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000000_0/taskjvm.sh
2013-10-31 18:35:07,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=null
2013-10-31 18:35:07,493 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47346, bytes: 28534, op: HDFS_READ, cliID: DFSClient_-549701899, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 184653
2013-10-31 18:35:07,494 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50259, bytes: 28534, op: HDFS_READ, cliID: DFSClient_-1442932776, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4560125798104689975_1171, duration: 171533
2013-10-31 18:35:07,508 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:07,508 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:07,545 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000003_0' to tip task_20131031182606197_0017_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:35:07,545 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000003
2013-10-31 18:35:07,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=null
2013-10-31 18:35:07,547 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:35:07,547 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000003_0 which needs 1 slots
2013-10-31 18:35:07,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=null
2013-10-31 18:35:07,547 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000003_0 which needs 1 slots
2013-10-31 18:35:07,550 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47631, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1442932776, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1767724206513468299_1168, duration: 924625
2013-10-31 18:35:07,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken	dst=null	perm=null
2013-10-31 18:35:07,551 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50261, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-549701899, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1767724206513468299_1168, duration: 1391822
2013-10-31 18:35:07,553 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43459, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5683982942081372135_1174, duration: 225668
2013-10-31 18:35:07,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml	dst=null	perm=null
2013-10-31 18:35:07,559 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47352, bytes: 28534, op: HDFS_READ, cliID: DFSClient_956388042, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 215709
2013-10-31 18:35:07,573 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:07,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar	dst=null	perm=null
2013-10-31 18:35:07,588 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47353, bytes: 239915, op: HDFS_READ, cliID: DFSClient_956388042, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1767724206513468299_1168, duration: 644551
2013-10-31 18:35:07,611 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_1734978570
2013-10-31 18:35:07,612 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_1734978570 spawned.
2013-10-31 18:35:07,613 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000002_0/taskjvm.sh
2013-10-31 18:35:07,614 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_502438488
2013-10-31 18:35:07,615 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_502438488 spawned.
2013-10-31 18:35:07,616 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000001_0/taskjvm.sh
2013-10-31 18:35:07,642 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_-172444087
2013-10-31 18:35:07,643 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_-172444087 spawned.
2013-10-31 18:35:07,644 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:07,644 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000003_0/taskjvm.sh
2013-10-31 18:35:07,644 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:07,644 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:07,644 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_91562867 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:07,646 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:07,646 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:07,646 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:07,646 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_2027104624 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:08,335 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_204403117 given task: attempt_20131031182606197_0017_m_000000_0
2013-10-31 18:35:08,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=null
2013-10-31 18:35:08,985 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47639, bytes: 1395, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 176459
2013-10-31 18:35:09,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000	dst=null	perm=null
2013-10-31 18:35:09,024 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50269, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8795753558913403673_1166, duration: 131378
2013-10-31 18:35:09,529 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_1734978570 given task: attempt_20131031182606197_0017_m_000002_0
2013-10-31 18:35:09,640 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_502438488 given task: attempt_20131031182606197_0017_m_000001_0
2013-10-31 18:35:09,646 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_-172444087 given task: attempt_20131031182606197_0017_m_000003_0
2013-10-31 18:35:10,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=null
2013-10-31 18:35:10,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47645, bytes: 879, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 172339
2013-10-31 18:35:10,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001	dst=null	perm=null
2013-10-31 18:35:10,083 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47648, bytes: 221, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9072667424849248381_1166, duration: 125278
2013-10-31 18:35:10,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=null
2013-10-31 18:35:10,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47649, bytes: 1395, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 181606
2013-10-31 18:35:10,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split	dst=null	perm=null
2013-10-31 18:35:10,164 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47650, bytes: 363, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 103109
2013-10-31 18:35:10,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003	dst=null	perm=null
2013-10-31 18:35:10,184 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43477, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4627257443058578093_1166, duration: 105707
2013-10-31 18:35:10,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002	dst=null	perm=null
2013-10-31 18:35:10,201 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50281, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9090210315426494664_1166, duration: 106101
2013-10-31 18:35:11,915 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000:0+264
2013-10-31 18:35:11,918 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000000_0 is done.
2013-10-31 18:35:11,918 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000000_0  was 196
2013-10-31 18:35:11,918 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:12,460 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0017_m_000005_0
2013-10-31 18:35:12,460 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0017_m_000005_0
2013-10-31 18:35:12,460 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0017_m_000005_0 not found in cache
2013-10-31 18:35:12,976 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001:0+217
2013-10-31 18:35:12,979 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000002_0 is done.
2013-10-31 18:35:12,979 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000002_0  was 149
2013-10-31 18:35:12,980 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:13,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003:0+264
2013-10-31 18:35:13,080 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000001_0 is done.
2013-10-31 18:35:13,080 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000001_0  was 196
2013-10-31 18:35:13,081 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:13,093 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002:0+70
2013-10-31 18:35:13,096 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000003_0 is done.
2013-10-31 18:35:13,096 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000003_0  was 6
2013-10-31 18:35:13,097 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:13,463 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000000_0' has completed task_20131031182606197_0017_m_000000 successfully.
2013-10-31 18:35:13,465 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0017_r_000000_0' to tip task_20131031182606197_0017_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:13,467 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:35:13,468 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_r_000000_0 which needs 1 slots
2013-10-31 18:35:13,468 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_r_000000_0 which needs 1 slots
2013-10-31 18:35:13,474 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000001_0' has completed task_20131031182606197_0017_m_000001 successfully.
2013-10-31 18:35:13,477 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000002_0' has completed task_20131031182606197_0017_m_000002 successfully.
2013-10-31 18:35:13,486 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_r_-1261202210
2013-10-31 18:35:13,487 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_r_-1261202210 spawned.
2013-10-31 18:35:13,490 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_r_000000_0/taskjvm.sh
2013-10-31 18:35:13,553 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000003_0' has completed task_20131031182606197_0017_m_000003 successfully.
2013-10-31 18:35:14,518 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_r_-1261202210 given task: attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:20,188 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44363, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000000_0, duration: 9250476
2013-10-31 18:35:20,213 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49322, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000001_0, duration: 10982992
2013-10-31 18:35:20,226 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39668, bytes: 149, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000002_0, duration: 8351218
2013-10-31 18:35:20,239 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41690, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000003_0, duration: 9487880
2013-10-31 18:35:21,012 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:21,062 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:21,118 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:21,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:21,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:21,338 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000. blk_1977604624338997367_1175
2013-10-31 18:35:21,360 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1977604624338997367_1175 src: /127.0.0.1:47660 dest: /127.0.0.1:54365
2013-10-31 18:35:21,361 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1977604624338997367_1175 src: /127.0.0.1:43487 dest: /127.0.0.1:59471
2013-10-31 18:35:21,361 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1977604624338997367_1175 src: /127.0.0.1:47379 dest: /127.0.0.1:37740
2013-10-31 18:35:21,365 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47379, dest: /127.0.0.1:37740, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0017_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1977604624338997367_1175, duration: 2728712
2013-10-31 18:35:21,365 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1977604624338997367_1175 terminating
2013-10-31 18:35:21,366 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43487, dest: /127.0.0.1:59471, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0017_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1977604624338997367_1175, duration: 3429618
2013-10-31 18:35:21,366 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1977604624338997367_1175 terminating
2013-10-31 18:35:21,366 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47660, dest: /127.0.0.1:54365, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0017_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1977604624338997367_1175, duration: 3690325
2013-10-31 18:35:21,366 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1977604624338997367_1175 terminating
2013-10-31 18:35:21,370 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1977604624338997367_1175 size 495
2013-10-31 18:35:21,370 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:21,370 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:21,370 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1977604624338997367_1175 size 495
2013-10-31 18:35:21,371 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1977604624338997367_1175 size 495
2013-10-31 18:35:21,406 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0017_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:21,406 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:22,478 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0017_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:35:22,479 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:23,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0	dst=null	perm=null
2013-10-31 18:35:23,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:23,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:23,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0	dst=null	perm=null
2013-10-31 18:35:24,061 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 1.0% reduce > reduce
2013-10-31 18:35:24,063 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 1.0% reduce > reduce
2013-10-31 18:35:24,064 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_r_000000_0 is done.
2013-10-31 18:35:24,064 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_r_000000_0  was -1
2013-10-31 18:35:24,064 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:25,483 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_r_000000_0' has completed task_20131031182606197_0017_r_000000 successfully.
2013-10-31 18:35:25,487 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0017_m_000004_0' to tip task_20131031182606197_0017_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:25,490 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:35:25,490 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000004_0 which needs 1 slots
2013-10-31 18:35:25,491 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000004_0 which needs 1 slots
2013-10-31 18:35:25,528 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0017/attempt_20131031182606197_0017_m_000004_0. Attempting to reuse: jvm_20131031182606197_0017_m_204403117
2013-10-31 18:35:25,990 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_204403117 given task: attempt_20131031182606197_0017_m_000004_0
2013-10-31 18:35:26,137 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000004_0 0.0% 
2013-10-31 18:35:26,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary	dst=null	perm=null
2013-10-31 18:35:26,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:26,154 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_SUCCESS from client DFSClient_attempt_20131031182606197_0017_m_000004_0
2013-10-31 18:35:26,154 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0017_m_000004_0
2013-10-31 18:35:26,268 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:26,269 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,269 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,269 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:26,270 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,270 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,270 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:26,270 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:26,271 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023221613854610402 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:26,271 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023221613854610402 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,271 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023221613854610402 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,272 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4560125798104689975 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:26,272 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4560125798104689975 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,272 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4560125798104689975 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017	dst=null	perm=null
2013-10-31 18:35:28,460 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_4501709775066199659_1169 blk_4560125798104689975_1171 blk_3023221613854610402_1170 blk_-1767724206513468299_1168
2013-10-31 18:35:28,460 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_4501709775066199659_1169 blk_4560125798104689975_1171 blk_-1767724206513468299_1168
2013-10-31 18:35:29,087 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000004_0 0.0% cleanup
2013-10-31 18:35:29,089 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data4/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:29,089 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023221613854610402_1170 file build/test/data/dfs/data/data4/current/blk_3023221613854610402 for deletion
2013-10-31 18:35:29,089 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000004_0 is done.
2013-10-31 18:35:29,089 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data3/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:29,089 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data4/current/blk_-1767724206513468299
2013-10-31 18:35:29,090 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4560125798104689975_1171 file build/test/data/dfs/data/data3/current/blk_4560125798104689975 for deletion
2013-10-31 18:35:29,090 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023221613854610402_1170 at file build/test/data/dfs/data/data4/current/blk_3023221613854610402
2013-10-31 18:35:29,090 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data3/current/blk_4501709775066199659
2013-10-31 18:35:29,090 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000004_0  was -1
2013-10-31 18:35:29,091 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4560125798104689975_1171 at file build/test/data/dfs/data/data3/current/blk_4560125798104689975
2013-10-31 18:35:29,091 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:30,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data8/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:30,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data8/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:30,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data8/current/blk_-1767724206513468299
2013-10-31 18:35:30,288 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4560125798104689975_1171 file build/test/data/dfs/data/data7/current/blk_4560125798104689975 for deletion
2013-10-31 18:35:30,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data8/current/blk_4501709775066199659
2013-10-31 18:35:30,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4560125798104689975_1171 at file build/test/data/dfs/data/data7/current/blk_4560125798104689975
2013-10-31 18:35:30,491 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:30,491 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:31,461 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_4501709775066199659_1169 blk_4560125798104689975_1171 blk_3023221613854610402_1170 blk_-1767724206513468299_1168
2013-10-31 18:35:31,461 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_4501709775066199659_1169 blk_3023221613854610402_1170 blk_-1767724206513468299_1168
2013-10-31 18:35:31,499 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000004_0' has completed task_20131031182606197_0017_m_000004 successfully.
2013-10-31 18:35:31,510 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0017 has completed successfully.
2013-10-31 18:35:31,511 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0017,submitTime=1383244499458,launchTime=1383244499967,firstMapTaskLaunchTime=1383244507438,firstReduceTaskLaunchTime=1383244513465,firstJobSetupTaskLaunchTime=1383244501421,firstJobCleanupTaskLaunchTime=1383244525487,finishTime=1383244531510,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D04322ECDC9F4E7281BF003BCAE07C61/2F135A3E8A604AB1BD6A2315B412481F] merged/(2/2) ...latform/splitsourcemerged
2013-10-31 18:35:31,516 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1. blk_-1185965224548220645_1176
2013-10-31 18:35:31,521 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1185965224548220645_1176 src: /127.0.0.1:43491 dest: /127.0.0.1:59471
2013-10-31 18:35:31,523 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1185965224548220645_1176 src: /127.0.0.1:50295 dest: /127.0.0.1:34578
2013-10-31 18:35:31,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1185965224548220645_1176 src: /127.0.0.1:47384 dest: /127.0.0.1:37740
2013-10-31 18:35:31,534 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47384, dest: /127.0.0.1:37740, bytes: 27800, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1185965224548220645_1176, duration: 3677976
2013-10-31 18:35:31,534 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1185965224548220645_1176 terminating
2013-10-31 18:35:31,535 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50295, dest: /127.0.0.1:34578, bytes: 27800, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1185965224548220645_1176, duration: 3887124
2013-10-31 18:35:31,535 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1185965224548220645_1176 terminating
2013-10-31 18:35:31,536 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43491, dest: /127.0.0.1:59471, bytes: 27800, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1185965224548220645_1176, duration: 4989530
2013-10-31 18:35:31,536 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1185965224548220645_1176 terminating
2013-10-31 18:35:31,539 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1185965224548220645_1176 size 27800
2013-10-31 18:35:31,539 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 from client DFSClient_-620184378
2013-10-31 18:35:31,540 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 is closed by DFSClient_-620184378
2013-10-31 18:35:31,540 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 928 Total time for transactions(ms): 22Number of transactions batched in Syncs: 83 Number of syncs: 640 SyncTimes(ms): 59291 13013 
2013-10-31 18:35:31,540 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1185965224548220645_1176 size 27800
2013-10-31 18:35:31,541 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1185965224548220645_1176 size 27800
2013-10-31 18:35:31,547 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:31,548 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000000_0'
2013-10-31 18:35:31,548 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000004_0'
2013-10-31 18:35:31,548 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000005_0'
2013-10-31 18:35:31,549 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_r_000000_0'
2013-10-31 18:35:31,550 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5683982942081372135 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,550 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000002_0'
2013-10-31 18:35:31,550 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5683982942081372135 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,551 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5683982942081372135 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:31,551 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000001_0'
2013-10-31 18:35:31,554 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0017_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:31,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017	dst=null	perm=null
2013-10-31 18:35:31,558 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2087420957165246899 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,559 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2087420957165246899 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,559 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2087420957165246899 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,559 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6789407230370558946 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,559 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6789407230370558946 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,559 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6789407230370558946 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,560 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8795753558913403673 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,560 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8795753558913403673 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:31,560 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8795753558913403673 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,560 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072667424849248381 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,561 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072667424849248381 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,561 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072667424849248381 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,561 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9090210315426494664 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,561 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9090210315426494664 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,561 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9090210315426494664 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:31,562 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4627257443058578093 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,562 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4627257443058578093 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,562 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4627257443058578093 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C	dst=null	perm=null
2013-10-31 18:35:31,569 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary
2013-10-31 18:35:31,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged	dst=null	perm=null
2013-10-31 18:35:31,590 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:35:31,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000	dst=null	perm=null
2013-10-31 18:35:31,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000	dst=null	perm=null
2013-10-31 18:35:31,595 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47386, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1977604624338997367_1175, duration: 261282
2013-10-31 18:35:31,596 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitsourcemerged
2013-10-31 18:35:31,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged	dst=null	perm=null
2013-10-31 18:35:31,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000	dst=null	perm=null
2013-10-31 18:35:31,604 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47387, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1977604624338997367_1175, duration: 265662
2013-10-31 18:35:31,622 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:35:31,622 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:35:31,630 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:35:31,630 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:35:31,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy"]
2013-10-31 18:35:31,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:35:31,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:35:31,631 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:35:31,632 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...fieldedpipesplatform/copy
2013-10-31 18:35:31,635 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:35:31,636 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:35:31,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:31,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:35:31,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,654 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar. blk_-5452196635493687275_1177
2013-10-31 18:35:31,655 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:43497 dest: /127.0.0.1:59471
2013-10-31 18:35:31,657 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:47389 dest: /127.0.0.1:37740
2013-10-31 18:35:31,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:47673 dest: /127.0.0.1:54365
2013-10-31 18:35:31,668 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47673, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5452196635493687275_1177, duration: 6554335
2013-10-31 18:35:31,668 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5452196635493687275_1177 terminating
2013-10-31 18:35:31,669 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47389, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5452196635493687275_1177, duration: 7355340
2013-10-31 18:35:31,669 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5452196635493687275_1177 terminating
2013-10-31 18:35:31,670 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43497, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5452196635493687275_1177, duration: 8627350
2013-10-31 18:35:31,670 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:31,670 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5452196635493687275_1177 terminating
2013-10-31 18:35:31,674 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:31,674 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar from client DFSClient_-1596270109
2013-10-31 18:35:31,675 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:35:31,675 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:31,680 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar. New replication is 10
2013-10-31 18:35:31,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=null
2013-10-31 18:35:31,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,691 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:35:31,695 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:35:31,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:35:31,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,707 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split. New replication is 10
2013-10-31 18:35:31,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=null
2013-10-31 18:35:31,713 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split. blk_2516087568850634061_1178
2013-10-31 18:35:31,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:47674 dest: /127.0.0.1:54365
2013-10-31 18:35:31,716 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:50304 dest: /127.0.0.1:34578
2013-10-31 18:35:31,718 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:43502 dest: /127.0.0.1:59471
2013-10-31 18:35:31,719 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:47394 dest: /127.0.0.1:37740
2013-10-31 18:35:31,723 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47394, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2516087568850634061_1178, duration: 103632
2013-10-31 18:35:31,723 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,723 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43502, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2516087568850634061_1178, duration: 1003593
2013-10-31 18:35:31,724 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,724 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50304, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2516087568850634061_1178, duration: 1959107
2013-10-31 18:35:31,725 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,725 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47674, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2516087568850634061_1178, duration: 2842169
2013-10-31 18:35:31,726 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,726 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,727 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,728 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split from client DFSClient_-1596270109
2013-10-31 18:35:31,728 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split is closed by DFSClient_-1596270109
2013-10-31 18:35:31,729 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,737 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000003_0'
2013-10-31 18:35:31,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,744 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo. blk_4046966012556952094_1179
2013-10-31 18:35:31,745 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4046966012556952094_1179 src: /127.0.0.1:50307 dest: /127.0.0.1:34578
2013-10-31 18:35:31,747 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4046966012556952094_1179 src: /127.0.0.1:43505 dest: /127.0.0.1:59471
2013-10-31 18:35:31,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4046966012556952094_1179 src: /127.0.0.1:47397 dest: /127.0.0.1:37740
2013-10-31 18:35:31,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47397, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4046966012556952094_1179, duration: 66768
2013-10-31 18:35:31,752 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4046966012556952094_1179 terminating
2013-10-31 18:35:31,752 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43505, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4046966012556952094_1179, duration: 863371
2013-10-31 18:35:31,753 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4046966012556952094_1179 terminating
2013-10-31 18:35:31,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50307, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4046966012556952094_1179, duration: 1870882
2013-10-31 18:35:31,754 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4046966012556952094_1179 terminating
2013-10-31 18:35:31,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4046966012556952094_1179 size 156
2013-10-31 18:35:31,757 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:35:31,757 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:35:31,758 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4046966012556952094_1179 size 156
2013-10-31 18:35:31,758 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4046966012556952094_1179 size 156
2013-10-31 18:35:31,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,778 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml. blk_8250117222170697749_1180
2013-10-31 18:35:31,779 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8250117222170697749_1180 src: /127.0.0.1:50310 dest: /127.0.0.1:34578
2013-10-31 18:35:31,781 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8250117222170697749_1180 src: /127.0.0.1:47682 dest: /127.0.0.1:54365
2013-10-31 18:35:31,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8250117222170697749_1180 src: /127.0.0.1:47400 dest: /127.0.0.1:37740
2013-10-31 18:35:31,786 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47400, dest: /127.0.0.1:37740, bytes: 26757, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 89983
2013-10-31 18:35:31,786 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8250117222170697749_1180 terminating
2013-10-31 18:35:31,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47682, dest: /127.0.0.1:54365, bytes: 26757, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8250117222170697749_1180, duration: 868595
2013-10-31 18:35:31,787 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8250117222170697749_1180 terminating
2013-10-31 18:35:31,788 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50310, dest: /127.0.0.1:34578, bytes: 26757, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8250117222170697749_1180, duration: 1843928
2013-10-31 18:35:31,788 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8250117222170697749_1180 terminating
2013-10-31 18:35:31,790 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8250117222170697749_1180 size 26757
2013-10-31 18:35:31,790 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml from client DFSClient_-1596270109
2013-10-31 18:35:31,791 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:35:31,791 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8250117222170697749_1180 size 26757
2013-10-31 18:35:31,792 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8250117222170697749_1180 size 26757
2013-10-31 18:35:31,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=null
2013-10-31 18:35:31,805 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47402, bytes: 26969, op: HDFS_READ, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 396757
2013-10-31 18:35:31,822 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0018: nMaps=4 nReduces=0 max=-1
2013-10-31 18:35:31,823 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0018 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:35:31,823 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0018	RESULT=SUCCESS
2013-10-31 18:35:31,823 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0018
2013-10-31 18:35:31,823 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0018
2013-10-31 18:35:31,823 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0018
2013-10-31 18:35:32,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:32,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:32,161 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml. blk_356557662131998172_1182
2013-10-31 18:35:32,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_356557662131998172_1182 src: /127.0.0.1:47686 dest: /127.0.0.1:54365
2013-10-31 18:35:32,164 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_356557662131998172_1182 src: /127.0.0.1:43513 dest: /127.0.0.1:59471
2013-10-31 18:35:32,165 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_356557662131998172_1182 src: /127.0.0.1:47405 dest: /127.0.0.1:37740
2013-10-31 18:35:32,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47405, dest: /127.0.0.1:37740, bytes: 26822, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_356557662131998172_1182, duration: 365490
2013-10-31 18:35:32,172 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_356557662131998172_1182 terminating
2013-10-31 18:35:32,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43513, dest: /127.0.0.1:59471, bytes: 26822, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_356557662131998172_1182, duration: 1583262
2013-10-31 18:35:32,174 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_356557662131998172_1182 terminating
2013-10-31 18:35:32,174 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47686, dest: /127.0.0.1:54365, bytes: 26822, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_356557662131998172_1182, duration: 2294764
2013-10-31 18:35:32,174 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_356557662131998172_1182 terminating
2013-10-31 18:35:32,175 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_356557662131998172_1182 size 26822
2013-10-31 18:35:32,175 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml from client DFSClient_-1879188964
2013-10-31 18:35:32,175 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml is closed by DFSClient_-1879188964
2013-10-31 18:35:32,176 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_356557662131998172_1182 size 26822
2013-10-31 18:35:32,176 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_356557662131998172_1182 size 26822
2013-10-31 18:35:32,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:32,186 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken. blk_9214137227429069223_1183
2013-10-31 18:35:32,187 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9214137227429069223_1183 src: /127.0.0.1:47689 dest: /127.0.0.1:54365
2013-10-31 18:35:32,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9214137227429069223_1183 src: /127.0.0.1:47407 dest: /127.0.0.1:37740
2013-10-31 18:35:32,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9214137227429069223_1183 src: /127.0.0.1:43517 dest: /127.0.0.1:59471
2013-10-31 18:35:32,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43517, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9214137227429069223_1183, duration: 41446
2013-10-31 18:35:32,190 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9214137227429069223_1183 terminating
2013-10-31 18:35:32,190 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9214137227429069223_1183 size 116
2013-10-31 18:35:32,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47407, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9214137227429069223_1183, duration: 558166
2013-10-31 18:35:32,191 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9214137227429069223_1183 terminating
2013-10-31 18:35:32,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47689, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9214137227429069223_1183, duration: 1113610
2013-10-31 18:35:32,191 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9214137227429069223_1183 terminating
2013-10-31 18:35:32,192 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken from client DFSClient_-1596270109
2013-10-31 18:35:32,192 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:35:32,192 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9214137227429069223_1183 size 116
2013-10-31 18:35:32,195 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9214137227429069223_1183 size 116
2013-10-31 18:35:32,195 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken
2013-10-31 18:35:32,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:35:32,197 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43518, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4046966012556952094_1179, duration: 117085
2013-10-31 18:35:32,198 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0018 = 1449. Number of splits = 4
2013-10-31 18:35:32,198 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0018 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:35:32,199 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0018 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:35:32,819 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data6/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:32,819 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023221613854610402_1170 file build/test/data/dfs/data/data6/current/blk_3023221613854610402 for deletion
2013-10-31 18:35:32,820 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data6/current/blk_-1767724206513468299
2013-10-31 18:35:32,820 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data5/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:32,820 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023221613854610402_1170 at file build/test/data/dfs/data/data6/current/blk_3023221613854610402
2013-10-31 18:35:32,820 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data5/current/blk_4501709775066199659
2013-10-31 18:35:33,216 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data1/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:33,217 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023221613854610402_1170 file build/test/data/dfs/data/data1/current/blk_3023221613854610402 for deletion
2013-10-31 18:35:33,217 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data1/current/blk_-1767724206513468299
2013-10-31 18:35:33,217 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data2/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:33,217 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023221613854610402_1170 at file build/test/data/dfs/data/data1/current/blk_3023221613854610402
2013-10-31 18:35:33,218 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data2/current/blk_4501709775066199659
2013-10-31 18:35:33,218 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4560125798104689975_1171 file build/test/data/dfs/data/data2/current/blk_4560125798104689975 for deletion
2013-10-31 18:35:33,219 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4560125798104689975_1171 at file build/test/data/dfs/data/data2/current/blk_4560125798104689975
2013-10-31 18:35:34,462 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-5452196635493687275_1177 to datanode(s) 127.0.0.1:34578
2013-10-31 18:35:34,463 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_9090210315426494664_1166 blk_8795753558913403673_1166 blk_5683982942081372135_1174
2013-10-31 18:35:34,463 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-4627257443058578093_1166 blk_2087420957165246899_1167 blk_-6789407230370558946_1161 blk_9090210315426494664_1166 blk_8795753558913403673_1166 blk_-9072667424849248381_1166
2013-10-31 18:35:34,555 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0018_m_000005_0' to tip task_20131031182606197_0018_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:34,564 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:35:34,565 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000005_0 which needs 1 slots
2013-10-31 18:35:34,565 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000005_0 which needs 1 slots
2013-10-31 18:35:34,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken	dst=null	perm=null
2013-10-31 18:35:34,774 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47413, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9214137227429069223_1183, duration: 348923
2013-10-31 18:35:34,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=null
2013-10-31 18:35:34,784 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47698, bytes: 26969, op: HDFS_READ, cliID: DFSClient_1414855396, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8250117222170697749_1180, duration: 376823
2013-10-31 18:35:34,812 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:34,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=null
2013-10-31 18:35:34,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47699, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1414855396, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5452196635493687275_1177, duration: 1533460
2013-10-31 18:35:34,953 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0017_m_-371996203
2013-10-31 18:35:34,960 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25717 with signal TERM. Exit code 0
2013-10-31 18:35:34,960 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_-1961485450
2013-10-31 18:35:34,961 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_-1961485450 spawned.
2013-10-31 18:35:34,963 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000005_0/taskjvm.sh
2013-10-31 18:35:35,044 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:35,045 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:35,045 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:35,045 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_-371996203 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:35,091 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-5452196635493687275_1177 to 127.0.0.1:34578 
2013-10-31 18:35:35,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072667424849248381_1166 file build/test/data/dfs/data/data4/current/blk_-9072667424849248381 for deletion
2013-10-31 18:35:35,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6789407230370558946_1161 file build/test/data/dfs/data/data3/current/blk_-6789407230370558946 for deletion
2013-10-31 18:35:35,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072667424849248381_1166 at file build/test/data/dfs/data/data4/current/blk_-9072667424849248381
2013-10-31 18:35:35,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4627257443058578093_1166 file build/test/data/dfs/data/data3/current/blk_-4627257443058578093 for deletion
2013-10-31 18:35:35,092 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6789407230370558946_1161 at file build/test/data/dfs/data/data3/current/blk_-6789407230370558946
2013-10-31 18:35:35,093 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2087420957165246899_1167 file build/test/data/dfs/data/data3/current/blk_2087420957165246899 for deletion
2013-10-31 18:35:35,093 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:50329 dest: /127.0.0.1:34578
2013-10-31 18:35:35,093 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-5452196635493687275_1177 to /127.0.0.1:34578
2013-10-31 18:35:35,093 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8795753558913403673_1166 file build/test/data/dfs/data/data4/current/blk_8795753558913403673 for deletion
2013-10-31 18:35:35,093 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4627257443058578093_1166 at file build/test/data/dfs/data/data3/current/blk_-4627257443058578093
2013-10-31 18:35:35,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9090210315426494664_1166 file build/test/data/dfs/data/data3/current/blk_9090210315426494664 for deletion
2013-10-31 18:35:35,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2087420957165246899_1167 at file build/test/data/dfs/data/data3/current/blk_2087420957165246899
2013-10-31 18:35:35,094 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8795753558913403673_1166 at file build/test/data/dfs/data/data4/current/blk_8795753558913403673
2013-10-31 18:35:35,095 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9090210315426494664_1166 at file build/test/data/dfs/data/data3/current/blk_9090210315426494664
2013-10-31 18:35:35,096 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5452196635493687275_1177 src: /127.0.0.1:50329 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:35:35,099 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:36,116 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_-1961485450 given task: attempt_20131031182606197_0018_m_000005_0
2013-10-31 18:35:36,176 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8976559195179578700_1001
2013-10-31 18:35:36,216 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5683982942081372135_1174 file build/test/data/dfs/data/data2/current/blk_5683982942081372135 for deletion
2013-10-31 18:35:36,216 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8795753558913403673_1166 file build/test/data/dfs/data/data2/current/blk_8795753558913403673 for deletion
2013-10-31 18:35:36,216 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5683982942081372135_1174 at file build/test/data/dfs/data/data2/current/blk_5683982942081372135
2013-10-31 18:35:36,216 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9090210315426494664_1166 file build/test/data/dfs/data/data1/current/blk_9090210315426494664 for deletion
2013-10-31 18:35:36,217 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8795753558913403673_1166 at file build/test/data/dfs/data/data2/current/blk_8795753558913403673
2013-10-31 18:35:36,217 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9090210315426494664_1166 at file build/test/data/dfs/data/data1/current/blk_9090210315426494664
2013-10-31 18:35:36,550 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,551 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0017_m_000004_0 not found in cache
2013-10-31 18:35:36,551 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936551
2013-10-31 18:35:36,551 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936552
2013-10-31 18:35:36,552 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,552 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936552
2013-10-31 18:35:36,592 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_r_-1261202210 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:36,599 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26151 with signal TERM. Exit code 0
2013-10-31 18:35:36,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:36,739 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,740 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936740
2013-10-31 18:35:36,751 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:36,751 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:36,751 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:36,751 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_r_-1261202210 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:37,127 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_204403117 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,139 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25863 with signal TERM. Exit code 0
2013-10-31 18:35:37,309 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,310 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,310 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:37,311 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_204403117 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:35:37,464 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-4627257443058578093_1166 blk_2087420957165246899_1167 blk_-6789407230370558946_1161 blk_9090210315426494664_1166 blk_8795753558913403673_1166 blk_-9072667424849248381_1166 blk_5683982942081372135_1174
2013-10-31 18:35:37,464 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-4627257443058578093_1166 blk_2087420957165246899_1167 blk_-6789407230370558946_1161 blk_-9072667424849248381_1166 blk_5683982942081372135_1174
2013-10-31 18:35:37,558 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_1734978570 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,566 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25945 with signal TERM. Exit code 0
2013-10-31 18:35:37,660 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_502438488 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,664 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25975 with signal TERM. Exit code 0
2013-10-31 18:35:37,670 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_-172444087 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,674 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25976 with signal TERM. Exit code 0
2013-10-31 18:35:37,769 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,769 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,769 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:37,770 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_1734978570 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:37,867 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,868 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,868 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:37,868 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_502438488 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:37,869 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,869 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,869 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:37,870 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_-172444087 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:38,007 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 42
2013-10-31 18:35:38,821 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072667424849248381_1166 file build/test/data/dfs/data/data5/current/blk_-9072667424849248381 for deletion
2013-10-31 18:35:38,821 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6789407230370558946_1161 file build/test/data/dfs/data/data6/current/blk_-6789407230370558946 for deletion
2013-10-31 18:35:38,821 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072667424849248381_1166 at file build/test/data/dfs/data/data5/current/blk_-9072667424849248381
2013-10-31 18:35:38,821 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4627257443058578093_1166 file build/test/data/dfs/data/data6/current/blk_-4627257443058578093 for deletion
2013-10-31 18:35:38,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6789407230370558946_1161 at file build/test/data/dfs/data/data6/current/blk_-6789407230370558946
2013-10-31 18:35:38,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2087420957165246899_1167 file build/test/data/dfs/data/data5/current/blk_2087420957165246899 for deletion
2013-10-31 18:35:38,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4627257443058578093_1166 at file build/test/data/dfs/data/data6/current/blk_-4627257443058578093
2013-10-31 18:35:38,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2087420957165246899_1167 at file build/test/data/dfs/data/data5/current/blk_2087420957165246899
2013-10-31 18:35:38,822 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5683982942081372135_1174 file build/test/data/dfs/data/data6/current/blk_5683982942081372135 for deletion
2013-10-31 18:35:38,823 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5683982942081372135_1174 at file build/test/data/dfs/data/data6/current/blk_5683982942081372135
2013-10-31 18:35:39,291 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072667424849248381_1166 file build/test/data/dfs/data/data8/current/blk_-9072667424849248381 for deletion
2013-10-31 18:35:39,291 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6789407230370558946_1161 file build/test/data/dfs/data/data8/current/blk_-6789407230370558946 for deletion
2013-10-31 18:35:39,291 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072667424849248381_1166 at file build/test/data/dfs/data/data8/current/blk_-9072667424849248381
2013-10-31 18:35:39,291 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4627257443058578093_1166 file build/test/data/dfs/data/data7/current/blk_-4627257443058578093 for deletion
2013-10-31 18:35:39,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6789407230370558946_1161 at file build/test/data/dfs/data/data8/current/blk_-6789407230370558946
2013-10-31 18:35:39,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4627257443058578093_1166 at file build/test/data/dfs/data/data7/current/blk_-4627257443058578093
2013-10-31 18:35:39,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2087420957165246899_1167 file build/test/data/dfs/data/data7/current/blk_2087420957165246899 for deletion
2013-10-31 18:35:39,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5683982942081372135_1174 file build/test/data/dfs/data/data7/current/blk_5683982942081372135 for deletion
2013-10-31 18:35:39,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2087420957165246899_1167 at file build/test/data/dfs/data/data7/current/blk_2087420957165246899
2013-10-31 18:35:39,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8795753558913403673_1166 file build/test/data/dfs/data/data8/current/blk_8795753558913403673 for deletion
2013-10-31 18:35:39,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5683982942081372135_1174 at file build/test/data/dfs/data/data7/current/blk_5683982942081372135
2013-10-31 18:35:39,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9090210315426494664_1166 file build/test/data/dfs/data/data7/current/blk_9090210315426494664 for deletion
2013-10-31 18:35:39,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8795753558913403673_1166 at file build/test/data/dfs/data/data8/current/blk_8795753558913403673
2013-10-31 18:35:39,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9090210315426494664_1166 at file build/test/data/dfs/data/data7/current/blk_9090210315426494664
2013-10-31 18:35:39,534 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000005_0 0.0% setup
2013-10-31 18:35:39,536 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000005_0 is done.
2013-10-31 18:35:39,536 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000005_0  was -1
2013-10-31 18:35:39,537 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:40,571 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000005_0' has completed task_20131031182606197_0018_m_000005 successfully.
2013-10-31 18:35:40,575 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000000_0' to tip task_20131031182606197_0018_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:40,577 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000000
2013-10-31 18:35:40,579 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:35:40,579 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000001_0' to tip task_20131031182606197_0018_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:35:40,580 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000000_0 which needs 1 slots
2013-10-31 18:35:40,580 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000001
2013-10-31 18:35:40,580 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000000_0 which needs 1 slots
2013-10-31 18:35:40,582 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:35:40,583 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000001_0 which needs 1 slots
2013-10-31 18:35:40,583 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000001_0 which needs 1 slots
2013-10-31 18:35:40,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken	dst=null	perm=null
2013-10-31 18:35:40,593 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43529, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9214137227429069223_1183, duration: 310508
2013-10-31 18:35:40,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=null
2013-10-31 18:35:40,603 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47705, bytes: 26969, op: HDFS_READ, cliID: DFSClient_575405771, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8250117222170697749_1180, duration: 395217
2013-10-31 18:35:40,606 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000002_0' to tip task_20131031182606197_0018_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:35:40,606 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000002
2013-10-31 18:35:40,607 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:35:40,608 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000002_0 which needs 1 slots
2013-10-31 18:35:40,608 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000002_0 which needs 1 slots
2013-10-31 18:35:40,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken	dst=null	perm=null
2013-10-31 18:35:40,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47706, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9214137227429069223_1183, duration: 142017
2013-10-31 18:35:40,613 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_260754084
2013-10-31 18:35:40,614 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_260754084 spawned.
2013-10-31 18:35:40,617 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000000_0/taskjvm.sh
2013-10-31 18:35:40,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=null
2013-10-31 18:35:40,622 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47425, bytes: 26969, op: HDFS_READ, cliID: DFSClient_-847711242, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 404934
2013-10-31 18:35:40,623 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:40,640 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:40,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=null
2013-10-31 18:35:40,649 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47426, bytes: 239915, op: HDFS_READ, cliID: DFSClient_575405771, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5452196635493687275_1177, duration: 604579
2013-10-31 18:35:40,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=null
2013-10-31 18:35:40,655 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50339, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-847711242, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5452196635493687275_1177, duration: 669880
2013-10-31 18:35:40,705 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_1768967875
2013-10-31 18:35:40,705 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_1768967875 spawned.
2013-10-31 18:35:40,707 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000001_0/taskjvm.sh
2013-10-31 18:35:40,709 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_1504803304
2013-10-31 18:35:40,710 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_1504803304 spawned.
2013-10-31 18:35:40,711 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000002_0/taskjvm.sh
2013-10-31 18:35:40,745 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000003_0' to tip task_20131031182606197_0018_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:35:40,746 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000003
2013-10-31 18:35:40,747 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:35:40,747 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000003_0 which needs 1 slots
2013-10-31 18:35:40,747 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000003_0 which needs 1 slots
2013-10-31 18:35:40,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken	dst=null	perm=null
2013-10-31 18:35:40,753 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43537, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9214137227429069223_1183, duration: 303873
2013-10-31 18:35:40,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml	dst=null	perm=null
2013-10-31 18:35:40,764 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47430, bytes: 26969, op: HDFS_READ, cliID: DFSClient_1098204263, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 423643
2013-10-31 18:35:40,781 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:40,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar	dst=null	perm=null
2013-10-31 18:35:40,812 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43540, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1098204263, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5452196635493687275_1177, duration: 1196068
2013-10-31 18:35:40,900 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_1536261407
2013-10-31 18:35:40,901 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_1536261407 spawned.
2013-10-31 18:35:40,902 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000003_0/taskjvm.sh
2013-10-31 18:35:44,017 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-2544570674502979241_1029
2013-10-31 18:35:45,252 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_1768967875 given task: attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:45,260 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_1504803304 given task: attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:45,264 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_1536261407 given task: attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:45,266 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_260754084 given task: attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:45,580 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0018_m_000005_0
2013-10-31 18:35:45,580 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0018_m_000005_0
2013-10-31 18:35:45,580 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000005_0 not found in cache
2013-10-31 18:35:45,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=null
2013-10-31 18:35:45,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=null
2013-10-31 18:35:45,755 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50353, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2516087568850634061_1178, duration: 257096
2013-10-31 18:35:45,758 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43551, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2516087568850634061_1178, duration: 143083
2013-10-31 18:35:45,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=null
2013-10-31 18:35:45,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split	dst=null	perm=null
2013-10-31 18:35:45,768 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50355, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2516087568850634061_1178, duration: 108121
2013-10-31 18:35:45,772 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47727, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2516087568850634061_1178, duration: 162620
2013-10-31 18:35:45,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:35:45,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:35:45,798 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47728, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 170421
2013-10-31 18:35:45,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:35:45,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,807 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47446, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 160930
2013-10-31 18:35:45,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:35:45,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,811 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50359, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 105277
2013-10-31 18:35:45,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,943 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47448, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 222713
2013-10-31 18:35:45,947 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001. blk_-3509723217345910061_1187
2013-10-31 18:35:45,950 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002. blk_-8392645727898236769_1187
2013-10-31 18:35:45,959 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003. blk_-2611001242749242842_1187
2013-10-31 18:35:45,962 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000. blk_-7428331401088541696_1187
2013-10-31 18:35:45,970 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3509723217345910061_1187 src: /127.0.0.1:47449 dest: /127.0.0.1:37740
2013-10-31 18:35:45,972 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3509723217345910061_1187 src: /127.0.0.1:47736 dest: /127.0.0.1:54365
2013-10-31 18:35:45,973 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3509723217345910061_1187 src: /127.0.0.1:43563 dest: /127.0.0.1:59471
2013-10-31 18:35:45,974 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8392645727898236769_1187 src: /127.0.0.1:47733 dest: /127.0.0.1:54365
2013-10-31 18:35:45,975 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8392645727898236769_1187 src: /127.0.0.1:50367 dest: /127.0.0.1:34578
2013-10-31 18:35:45,975 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8392645727898236769_1187 src: /127.0.0.1:47456 dest: /127.0.0.1:37740
2013-10-31 18:35:45,976 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43563, dest: /127.0.0.1:59471, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3509723217345910061_1187, duration: 1365266
2013-10-31 18:35:45,978 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3509723217345910061_1187 terminating
2013-10-31 18:35:45,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47736, dest: /127.0.0.1:54365, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3509723217345910061_1187, duration: 4173743
2013-10-31 18:35:45,981 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3509723217345910061_1187 size 391
2013-10-31 18:35:45,981 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3509723217345910061_1187 terminating
2013-10-31 18:35:45,981 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47456, dest: /127.0.0.1:37740, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8392645727898236769_1187, duration: 2334177
2013-10-31 18:35:45,981 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8392645727898236769_1187 terminating
2013-10-31 18:35:45,981 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50367, dest: /127.0.0.1:34578, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8392645727898236769_1187, duration: 2931471
2013-10-31 18:35:45,982 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8392645727898236769_1187 terminating
2013-10-31 18:35:45,982 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47449, dest: /127.0.0.1:37740, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3509723217345910061_1187, duration: 6472174
2013-10-31 18:35:45,983 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8392645727898236769_1187 size 433
2013-10-31 18:35:45,983 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3509723217345910061_1187 terminating
2013-10-31 18:35:45,984 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47733, dest: /127.0.0.1:54365, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8392645727898236769_1187, duration: 2687281
2013-10-31 18:35:45,984 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3509723217345910061_1187 size 391
2013-10-31 18:35:45,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8392645727898236769_1187 terminating
2013-10-31 18:35:45,984 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3509723217345910061_1187 size 391
2013-10-31 18:35:45,984 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:45,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2611001242749242842_1187 src: /127.0.0.1:50363 dest: /127.0.0.1:34578
2013-10-31 18:35:45,985 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:45,985 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8392645727898236769_1187 size 433
2013-10-31 18:35:45,985 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:45,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2611001242749242842_1187 src: /127.0.0.1:47457 dest: /127.0.0.1:37740
2013-10-31 18:35:45,986 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:45,986 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8392645727898236769_1187 size 433
2013-10-31 18:35:45,986 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2611001242749242842_1187 src: /127.0.0.1:43567 dest: /127.0.0.1:59471
2013-10-31 18:35:45,987 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428331401088541696_1187 src: /127.0.0.1:47452 dest: /127.0.0.1:37740
2013-10-31 18:35:45,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428331401088541696_1187 src: /127.0.0.1:50371 dest: /127.0.0.1:34578
2013-10-31 18:35:45,989 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43567, dest: /127.0.0.1:59471, bytes: 307, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2611001242749242842_1187, duration: 1538847
2013-10-31 18:35:45,989 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2611001242749242842_1187 terminating
2013-10-31 18:35:45,989 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2611001242749242842_1187 size 307
2013-10-31 18:35:45,989 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47457, dest: /127.0.0.1:37740, bytes: 307, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2611001242749242842_1187, duration: 1878794
2013-10-31 18:35:45,989 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2611001242749242842_1187 terminating
2013-10-31 18:35:45,993 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2611001242749242842_1187 size 307
2013-10-31 18:35:46,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50363, dest: /127.0.0.1:34578, bytes: 307, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2611001242749242842_1187, duration: 94783756
2013-10-31 18:35:46,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428331401088541696_1187 src: /127.0.0.1:47743 dest: /127.0.0.1:54365
2013-10-31 18:35:46,082 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2611001242749242842_1187 terminating
2013-10-31 18:35:46,083 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:46,086 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:46,086 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2611001242749242842_1187 size 307
2013-10-31 18:35:46,086 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47743, dest: /127.0.0.1:54365, bytes: 319, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7428331401088541696_1187, duration: 1703955
2013-10-31 18:35:46,086 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7428331401088541696_1187 terminating
2013-10-31 18:35:46,086 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50371, dest: /127.0.0.1:34578, bytes: 319, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7428331401088541696_1187, duration: 1623641
2013-10-31 18:35:46,087 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7428331401088541696_1187 terminating
2013-10-31 18:35:46,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47452, dest: /127.0.0.1:37740, bytes: 319, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7428331401088541696_1187, duration: 1173195
2013-10-31 18:35:46,087 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7428331401088541696_1187 terminating
2013-10-31 18:35:46,087 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7428331401088541696_1187 size 319
2013-10-31 18:35:46,088 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:46,088 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:46,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7428331401088541696_1187 size 319
2013-10-31 18:35:46,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7428331401088541696_1187 size 319
2013-10-31 18:35:46,258 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,258 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000001_0 0.0% 
2013-10-31 18:35:46,259 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,259 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000002_0 0.0% 
2013-10-31 18:35:46,260 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,260 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000000_0 0.0% 
2013-10-31 18:35:46,262 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,262 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000003_0 0.0% 
2013-10-31 18:35:46,585 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:46,588 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:46,613 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:46,753 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:47,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0	dst=null	perm=null
2013-10-31 18:35:47,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0	dst=null	perm=null
2013-10-31 18:35:47,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0	dst=null	perm=null
2013-10-31 18:35:47,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0	dst=null	perm=null
2013-10-31 18:35:47,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0	dst=null	perm=null
2013-10-31 18:35:47,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0	dst=null	perm=null
2013-10-31 18:35:47,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0	dst=null	perm=null
2013-10-31 18:35:47,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0	dst=null	perm=null
2013-10-31 18:35:48,682 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:35:48,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000001_0 is done.
2013-10-31 18:35:48,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000001_0  was -1
2013-10-31 18:35:48,684 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:48,687 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:35:48,689 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000002_0 is done.
2013-10-31 18:35:48,689 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000002_0  was -1
2013-10-31 18:35:48,689 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:48,694 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:35:48,696 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000000_0 is done.
2013-10-31 18:35:48,696 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000000_0  was -1
2013-10-31 18:35:48,696 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:48,697 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:35:48,699 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000003_0 is done.
2013-10-31 18:35:48,699 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000003_0  was -1
2013-10-31 18:35:48,699 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:49,589 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000000_0' has completed task_20131031182606197_0018_m_000000 successfully.
2013-10-31 18:35:49,592 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000001_0' has completed task_20131031182606197_0018_m_000001 successfully.
2013-10-31 18:35:49,617 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000002_0' has completed task_20131031182606197_0018_m_000002 successfully.
2013-10-31 18:35:49,757 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000003_0' has completed task_20131031182606197_0018_m_000003 successfully.
2013-10-31 18:35:49,760 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0018_m_000004_0' to tip task_20131031182606197_0018_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:35:49,763 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:35:49,763 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000004_0 which needs 1 slots
2013-10-31 18:35:49,763 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000004_0 which needs 1 slots
2013-10-31 18:35:49,792 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_646899489
2013-10-31 18:35:49,792 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_646899489 spawned.
2013-10-31 18:35:49,794 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000004_0/taskjvm.sh
2013-10-31 18:35:50,672 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_646899489 given task: attempt_20131031182606197_0018_m_000004_0
2013-10-31 18:35:51,210 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000004_0 0.0% 
2013-10-31 18:35:51,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary	dst=null	perm=null
2013-10-31 18:35:51,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:51,229 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_SUCCESS from client DFSClient_attempt_20131031182606197_0018_m_000004_0
2013-10-31 18:35:51,229 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0018_m_000004_0
2013-10-31 18:35:51,234 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:51,234 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,234 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:51,234 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,234 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4046966012556952094 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4046966012556952094 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4046966012556952094 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8250117222170697749 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8250117222170697749 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:51,235 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8250117222170697749 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018	dst=null	perm=null
2013-10-31 18:35:52,467 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_8250117222170697749_1180 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:52,468 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_8250117222170697749_1180 blk_4046966012556952094_1179 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:53,097 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data3/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:53,097 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data4/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:53,098 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data3/current/blk_-5452196635493687275
2013-10-31 18:35:53,098 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8250117222170697749_1180 file build/test/data/dfs/data/data3/current/blk_8250117222170697749 for deletion
2013-10-31 18:35:53,098 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data4/current/blk_2516087568850634061
2013-10-31 18:35:53,098 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8250117222170697749_1180 at file build/test/data/dfs/data/data3/current/blk_8250117222170697749
2013-10-31 18:35:54,122 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000004_0 0.0% cleanup
2013-10-31 18:35:54,123 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000004_0 is done.
2013-10-31 18:35:54,124 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000004_0  was -1
2013-10-31 18:35:54,124 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:54,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data7/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:54,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data8/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:54,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data7/current/blk_-5452196635493687275
2013-10-31 18:35:54,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data8/current/blk_2516087568850634061
2013-10-31 18:35:54,296 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4046966012556952094_1179 file build/test/data/dfs/data/data7/current/blk_4046966012556952094 for deletion
2013-10-31 18:35:54,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8250117222170697749_1180 file build/test/data/dfs/data/data8/current/blk_8250117222170697749 for deletion
2013-10-31 18:35:54,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4046966012556952094_1179 at file build/test/data/dfs/data/data7/current/blk_4046966012556952094
2013-10-31 18:35:54,298 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8250117222170697749_1180 at file build/test/data/dfs/data/data8/current/blk_8250117222170697749
2013-10-31 18:35:55,312 WARN  namenode.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(210)) - PendingReplicationMonitor timed out block blk_-2141313976185548712_1012
2013-10-31 18:35:55,468 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_8250117222170697749_1180 blk_4046966012556952094_1179 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:55,468 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_4046966012556952094_1179 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:55,769 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000004_0' has completed task_20131031182606197_0018_m_000004 successfully.
2013-10-31 18:35:55,770 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0018 has completed successfully.
2013-10-31 18:35:55,771 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0018,submitTime=1383244531795,launchTime=1383244532199,firstMapTaskLaunchTime=1383244540575,firstJobSetupTaskLaunchTime=1383244534555,firstJobCleanupTaskLaunchTime=1383244549760,finishTime=1383244555770,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[DE2FABFEAB294B7BBE737B0CAF0B922E/7D11D1356CE44E77A226D5B8FC3E0762] test/(1/1) ...fieldedpipesplatform/copy
2013-10-31 18:35:55,777 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77. blk_-5440852137687465415_1188
2013-10-31 18:35:55,779 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5440852137687465415_1188 src: /127.0.0.1:47748 dest: /127.0.0.1:54365
2013-10-31 18:35:55,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5440852137687465415_1188 src: /127.0.0.1:47466 dest: /127.0.0.1:37740
2013-10-31 18:35:55,784 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5440852137687465415_1188 src: /127.0.0.1:50379 dest: /127.0.0.1:34578
2013-10-31 18:35:55,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50379, dest: /127.0.0.1:34578, bytes: 22691, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5440852137687465415_1188, duration: 87838
2013-10-31 18:35:55,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5440852137687465415_1188 terminating
2013-10-31 18:35:55,791 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5440852137687465415_1188 size 22691
2013-10-31 18:35:55,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47466, dest: /127.0.0.1:37740, bytes: 22691, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5440852137687465415_1188, duration: 4457693
2013-10-31 18:35:55,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5440852137687465415_1188 terminating
2013-10-31 18:35:55,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47748, dest: /127.0.0.1:54365, bytes: 22691, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5440852137687465415_1188, duration: 5330890
2013-10-31 18:35:55,792 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5440852137687465415_1188 terminating
2013-10-31 18:35:55,792 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5440852137687465415_1188 size 22691
2013-10-31 18:35:55,796 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5440852137687465415_1188 size 22691
2013-10-31 18:35:55,797 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 from client DFSClient_-1879188964
2013-10-31 18:35:55,798 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 is closed by DFSClient_-1879188964
2013-10-31 18:35:55,804 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:55,805 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000003_0'
2013-10-31 18:35:55,805 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000004_0'
2013-10-31 18:35:55,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9214137227429069223 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:55,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9214137227429069223 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:55,807 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9214137227429069223 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:55,811 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary
2013-10-31 18:35:55,812 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0018_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:55,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018	dst=null	perm=null
2013-10-31 18:35:55,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy	dst=null	perm=null
2013-10-31 18:35:55,860 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:35:55,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000	dst=null	perm=null
2013-10-31 18:35:55,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001	dst=null	perm=null
2013-10-31 18:35:55,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002	dst=null	perm=null
2013-10-31 18:35:55,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003	dst=null	perm=null
2013-10-31 18:35:55,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000	dst=null	perm=null
2013-10-31 18:35:55,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47469, bytes: 323, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7428331401088541696_1187, duration: 279950
2013-10-31 18:35:55,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001	dst=null	perm=null
2013-10-31 18:35:55,873 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47753, bytes: 395, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3509723217345910061_1187, duration: 263227
2013-10-31 18:35:55,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002	dst=null	perm=null
2013-10-31 18:35:55,876 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47754, bytes: 437, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8392645727898236769_1187, duration: 284107
2013-10-31 18:35:55,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003	dst=null	perm=null
2013-10-31 18:35:55,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47472, bytes: 311, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2611001242749242842_1187, duration: 259895
2013-10-31 18:35:55,879 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/copy
2013-10-31 18:35:55,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy	dst=null	perm=null
2013-10-31 18:35:55,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000	dst=null	perm=null
2013-10-31 18:35:55,888 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50385, bytes: 323, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7428331401088541696_1187, duration: 278804
2013-10-31 18:35:55,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001	dst=null	perm=null
2013-10-31 18:35:55,892 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47474, bytes: 395, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3509723217345910061_1187, duration: 269358
2013-10-31 18:35:55,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002	dst=null	perm=null
2013-10-31 18:35:55,896 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50387, bytes: 437, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8392645727898236769_1187, duration: 267467
2013-10-31 18:35:55,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003	dst=null	perm=null
2013-10-31 18:35:55,901 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43585, bytes: 311, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2611001242749242842_1187, duration: 261766
2013-10-31 18:35:55,923 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:35:55,923 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:35:55,937 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:35:55,937 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:35:55,937 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->['count', 'ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none"]
2013-10-31 18:35:55,937 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:35:55,937 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:35:55,937 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:35:55,938 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...fieldedpipesplatform/none
2013-10-31 18:35:55,941 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:35:55,941 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:35:56,007 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:35:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,051 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,059 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,065 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,071 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,071 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:35:56,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:56,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:35:56,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,116 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar. blk_-3901584568493252230_1189
2013-10-31 18:35:56,118 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:50389 dest: /127.0.0.1:34578
2013-10-31 18:35:56,120 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:43587 dest: /127.0.0.1:59471
2013-10-31 18:35:56,121 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:47762 dest: /127.0.0.1:54365
2013-10-31 18:35:56,129 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47762, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3901584568493252230_1189, duration: 3869414
2013-10-31 18:35:56,129 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3901584568493252230_1189 terminating
2013-10-31 18:35:56,129 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43587, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3901584568493252230_1189, duration: 4947231
2013-10-31 18:35:56,130 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3901584568493252230_1189 terminating
2013-10-31 18:35:56,130 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:35:56,130 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50389, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3901584568493252230_1189, duration: 5673334
2013-10-31 18:35:56,131 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3901584568493252230_1189 terminating
2013-10-31 18:35:56,133 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar from client DFSClient_-1596270109
2013-10-31 18:35:56,134 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:35:56,134 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:35:56,135 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:35:56,139 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar. New replication is 10
2013-10-31 18:35:56,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=null
2013-10-31 18:35:56,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,147 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:35:56,153 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:35:56,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:35:56,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,166 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split. New replication is 10
2013-10-31 18:35:56,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=null
2013-10-31 18:35:56,173 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split. blk_-5772430696144033641_1190
2013-10-31 18:35:56,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:50392 dest: /127.0.0.1:34578
2013-10-31 18:35:56,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:43590 dest: /127.0.0.1:59471
2013-10-31 18:35:56,178 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:47765 dest: /127.0.0.1:54365
2013-10-31 18:35:56,180 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:47483 dest: /127.0.0.1:37740
2013-10-31 18:35:56,183 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47483, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5772430696144033641_1190, duration: 187214
2013-10-31 18:35:56,183 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,184 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47765, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5772430696144033641_1190, duration: 1055598
2013-10-31 18:35:56,184 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,185 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43590, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5772430696144033641_1190, duration: 2101529
2013-10-31 18:35:56,185 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,186 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50392, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5772430696144033641_1190, duration: 2899574
2013-10-31 18:35:56,186 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,187 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,188 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split from client DFSClient_-1596270109
2013-10-31 18:35:56,188 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split is closed by DFSClient_-1596270109
2013-10-31 18:35:56,189 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,189 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,190 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,206 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo. blk_-7894420003126651925_1191
2013-10-31 18:35:56,208 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7894420003126651925_1191 src: /127.0.0.1:43593 dest: /127.0.0.1:59471
2013-10-31 18:35:56,209 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7894420003126651925_1191 src: /127.0.0.1:47485 dest: /127.0.0.1:37740
2013-10-31 18:35:56,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7894420003126651925_1191 src: /127.0.0.1:50398 dest: /127.0.0.1:34578
2013-10-31 18:35:56,214 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50398, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7894420003126651925_1191, duration: 68673
2013-10-31 18:35:56,214 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7894420003126651925_1191 terminating
2013-10-31 18:35:56,215 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47485, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7894420003126651925_1191, duration: 856177
2013-10-31 18:35:56,215 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7894420003126651925_1191 terminating
2013-10-31 18:35:56,215 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7894420003126651925_1191 size 156
2013-10-31 18:35:56,215 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43593, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7894420003126651925_1191, duration: 1763611
2013-10-31 18:35:56,216 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7894420003126651925_1191 terminating
2013-10-31 18:35:56,221 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7894420003126651925_1191 size 156
2013-10-31 18:35:56,221 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7894420003126651925_1191 size 156
2013-10-31 18:35:56,222 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:35:56,222 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:35:56,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,247 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml. blk_3017248074108405270_1192
2013-10-31 18:35:56,249 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3017248074108405270_1192 src: /127.0.0.1:47487 dest: /127.0.0.1:37740
2013-10-31 18:35:56,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3017248074108405270_1192 src: /127.0.0.1:47771 dest: /127.0.0.1:54365
2013-10-31 18:35:56,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3017248074108405270_1192 src: /127.0.0.1:50401 dest: /127.0.0.1:34578
2013-10-31 18:35:56,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50401, dest: /127.0.0.1:34578, bytes: 28367, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3017248074108405270_1192, duration: 67423
2013-10-31 18:35:56,255 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3017248074108405270_1192 terminating
2013-10-31 18:35:56,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47771, dest: /127.0.0.1:54365, bytes: 28367, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3017248074108405270_1192, duration: 837349
2013-10-31 18:35:56,256 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3017248074108405270_1192 terminating
2013-10-31 18:35:56,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47487, dest: /127.0.0.1:37740, bytes: 28367, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3017248074108405270_1192, duration: 1642469
2013-10-31 18:35:56,257 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3017248074108405270_1192 terminating
2013-10-31 18:35:56,260 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3017248074108405270_1192 size 28367
2013-10-31 18:35:56,261 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3017248074108405270_1192 size 28367
2013-10-31 18:35:56,261 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3017248074108405270_1192 size 28367
2013-10-31 18:35:56,661 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml from client DFSClient_-1596270109
2013-10-31 18:35:56,661 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:35:56,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=null
2013-10-31 18:35:56,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50403, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-813892404, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3017248074108405270_1192, duration: 407517
2013-10-31 18:35:56,693 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0019: nMaps=4 nReduces=1 max=-1
2013-10-31 18:35:56,694 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0019 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:35:56,694 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0019
2013-10-31 18:35:56,694 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0019	RESULT=SUCCESS
2013-10-31 18:35:56,694 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0019
2013-10-31 18:35:56,695 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0019
2013-10-31 18:35:56,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data5/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:56,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data6/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:56,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data5/current/blk_-5452196635493687275
2013-10-31 18:35:56,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4046966012556952094_1179 file build/test/data/dfs/data/data5/current/blk_4046966012556952094 for deletion
2013-10-31 18:35:56,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data6/current/blk_2516087568850634061
2013-10-31 18:35:56,828 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4046966012556952094_1179 at file build/test/data/dfs/data/data5/current/blk_4046966012556952094
2013-10-31 18:35:56,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,938 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml. blk_3381914167307845159_1194
2013-10-31 18:35:56,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3381914167307845159_1194 src: /127.0.0.1:47492 dest: /127.0.0.1:37740
2013-10-31 18:35:56,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3381914167307845159_1194 src: /127.0.0.1:47776 dest: /127.0.0.1:54365
2013-10-31 18:35:56,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3381914167307845159_1194 src: /127.0.0.1:43603 dest: /127.0.0.1:59471
2013-10-31 18:35:56,948 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43603, dest: /127.0.0.1:59471, bytes: 28432, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3381914167307845159_1194, duration: 633627
2013-10-31 18:35:56,948 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3381914167307845159_1194 terminating
2013-10-31 18:35:56,949 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47776, dest: /127.0.0.1:54365, bytes: 28432, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3381914167307845159_1194, duration: 1433059
2013-10-31 18:35:56,949 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3381914167307845159_1194 terminating
2013-10-31 18:35:56,949 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47492, dest: /127.0.0.1:37740, bytes: 28432, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3381914167307845159_1194, duration: 2666302
2013-10-31 18:35:56,950 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3381914167307845159_1194 terminating
2013-10-31 18:35:56,951 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3381914167307845159_1194 size 28432
2013-10-31 18:35:56,952 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml from client DFSClient_-813892404
2013-10-31 18:35:56,952 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml is closed by DFSClient_-813892404
2013-10-31 18:35:56,953 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3381914167307845159_1194 size 28432
2013-10-31 18:35:56,954 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3381914167307845159_1194 size 28432
2013-10-31 18:35:56,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,964 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken. blk_8125310525460418873_1195
2013-10-31 18:35:56,966 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8125310525460418873_1195 src: /127.0.0.1:47778 dest: /127.0.0.1:54365
2013-10-31 18:35:56,967 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8125310525460418873_1195 src: /127.0.0.1:43605 dest: /127.0.0.1:59471
2013-10-31 18:35:56,969 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8125310525460418873_1195 src: /127.0.0.1:50409 dest: /127.0.0.1:34578
2013-10-31 18:35:56,972 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50409, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8125310525460418873_1195, duration: 94360
2013-10-31 18:35:56,972 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8125310525460418873_1195 terminating
2013-10-31 18:35:56,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43605, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8125310525460418873_1195, duration: 869825
2013-10-31 18:35:56,973 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8125310525460418873_1195 terminating
2013-10-31 18:35:56,974 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8125310525460418873_1195 size 116
2013-10-31 18:35:56,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47778, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8125310525460418873_1195, duration: 1830627
2013-10-31 18:35:56,974 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8125310525460418873_1195 size 116
2013-10-31 18:35:56,975 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8125310525460418873_1195 terminating
2013-10-31 18:35:56,977 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken from client DFSClient_-1596270109
2013-10-31 18:35:56,977 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:35:56,978 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8125310525460418873_1195 size 116
2013-10-31 18:35:56,981 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken
2013-10-31 18:35:56,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:35:56,985 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50410, bytes: 160, op: HDFS_READ, cliID: DFSClient_-813892404, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7894420003126651925_1191, duration: 287301
2013-10-31 18:35:56,987 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0019 = 1449. Number of splits = 4
2013-10-31 18:35:56,987 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,987 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,987 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,990 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,990 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0019 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:35:56,991 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0019 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:35:57,224 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data1/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:57,224 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data2/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:57,224 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data1/current/blk_-5452196635493687275
2013-10-31 18:35:57,224 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data2/current/blk_2516087568850634061
2013-10-31 18:35:57,224 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4046966012556952094_1179 file build/test/data/dfs/data/data1/current/blk_4046966012556952094 for deletion
2013-10-31 18:35:57,225 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8250117222170697749_1180 file build/test/data/dfs/data/data2/current/blk_8250117222170697749 for deletion
2013-10-31 18:35:57,225 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4046966012556952094_1179 at file build/test/data/dfs/data/data1/current/blk_4046966012556952094
2013-10-31 18:35:57,226 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8250117222170697749_1180 at file build/test/data/dfs/data/data2/current/blk_8250117222170697749
2013-10-31 18:35:58,469 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-3901584568493252230_1189 to datanode(s) 127.0.0.1:37740
2013-10-31 18:35:58,470 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_9214137227429069223_1183
2013-10-31 18:35:58,470 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_9214137227429069223_1183
2013-10-31 18:35:58,603 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0019_m_000005_0' to tip task_20131031182606197_0019_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:58,608 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000000_0'
2013-10-31 18:35:58,608 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000005_0'
2013-10-31 18:35:58,610 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000001_0'
2013-10-31 18:35:58,611 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:35:58,612 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000005_0 which needs 1 slots
2013-10-31 18:35:58,612 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000005_0 which needs 1 slots
2013-10-31 18:35:58,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken	dst=null	perm=null
2013-10-31 18:35:58,620 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50411, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8125310525460418873_1195, duration: 291120
2013-10-31 18:35:58,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=null
2013-10-31 18:35:58,627 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000002_0'
2013-10-31 18:35:58,630 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47784, bytes: 28591, op: HDFS_READ, cliID: DFSClient_145711421, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3017248074108405270_1192, duration: 389307
2013-10-31 18:35:58,660 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:58,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=null
2013-10-31 18:35:58,691 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47785, bytes: 239915, op: HDFS_READ, cliID: DFSClient_145711421, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3901584568493252230_1189, duration: 1248752
2013-10-31 18:35:58,791 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0018_m_-1961485450
2013-10-31 18:35:58,797 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26365 with signal TERM. Exit code 0
2013-10-31 18:35:58,797 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_-570022639
2013-10-31 18:35:58,798 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_-570022639 spawned.
2013-10-31 18:35:58,799 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000005_0/taskjvm.sh
2013-10-31 18:35:59,286 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:59,286 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:59,286 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:35:59,288 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_-1961485450 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:59,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9214137227429069223_1183 file build/test/data/dfs/data/data5/current/blk_9214137227429069223 for deletion
2013-10-31 18:35:59,827 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9214137227429069223_1183 at file build/test/data/dfs/data/data5/current/blk_9214137227429069223
2013-10-31 18:36:00,094 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_-570022639 given task: attempt_20131031182606197_0019_m_000005_0
2013-10-31 18:36:00,224 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-3901584568493252230_1189 to 127.0.0.1:37740 
2013-10-31 18:36:00,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:47504 dest: /127.0.0.1:37740
2013-10-31 18:36:00,225 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-3901584568493252230_1189 to /127.0.0.1:37740
2013-10-31 18:36:00,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3901584568493252230_1189 src: /127.0.0.1:47504 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:36:00,229 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:36:00,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9214137227429069223_1183 file build/test/data/dfs/data/data8/current/blk_9214137227429069223 for deletion
2013-10-31 18:36:00,297 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9214137227429069223_1183 at file build/test/data/dfs/data/data8/current/blk_9214137227429069223
2013-10-31 18:36:00,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:00,805 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:00,806 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000004_0 not found in cache
2013-10-31 18:36:00,806 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000003_0 not found in cache
2013-10-31 18:36:00,807 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330960807
2013-10-31 18:36:01,263 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_1536261407 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:01,274 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26566 with signal TERM. Exit code 0
2013-10-31 18:36:01,471 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_9214137227429069223_1183
2013-10-31 18:36:01,483 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:01,484 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:01,484 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:01,484 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_1536261407 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:02,099 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9214137227429069223_1183 file build/test/data/dfs/data/data3/current/blk_9214137227429069223 for deletion
2013-10-31 18:36:02,099 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9214137227429069223_1183 at file build/test/data/dfs/data/data3/current/blk_9214137227429069223
2013-10-31 18:36:02,189 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_646899489 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:02,197 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26833 with signal TERM. Exit code 0
2013-10-31 18:36:02,360 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:02,360 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:02,360 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:02,361 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_646899489 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:03,524 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000005_0 0.0% setup
2013-10-31 18:36:03,527 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000005_0 is done.
2013-10-31 18:36:03,528 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000005_0  was -1
2013-10-31 18:36:03,528 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:03,612 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:03,612 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:03,612 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000001_0 not found in cache
2013-10-31 18:36:03,612 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000000_0 not found in cache
2013-10-31 18:36:03,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330963613
2013-10-31 18:36:03,613 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330963613
2013-10-31 18:36:03,628 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:03,629 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000002_0 not found in cache
2013-10-31 18:36:03,629 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330963629
2013-10-31 18:36:04,249 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_1768967875 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:04,252 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_1504803304 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:04,259 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26567 with signal TERM. Exit code 0
2013-10-31 18:36:04,262 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26565 with signal TERM. Exit code 0
2013-10-31 18:36:04,264 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_260754084 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:04,273 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26568 with signal TERM. Exit code 0
2013-10-31 18:36:04,464 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:04,465 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:04,465 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:04,465 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_1504803304 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:04,466 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:04,466 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:04,466 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:04,467 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_260754084 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:04,617 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000005_0' has completed task_20131031182606197_0019_m_000005 successfully.
2013-10-31 18:36:04,620 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000000_0' to tip task_20131031182606197_0019_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:04,621 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000000
2013-10-31 18:36:04,624 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000001_0' to tip task_20131031182606197_0019_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:36:04,624 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:04,624 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000001
2013-10-31 18:36:04,624 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000000_0 which needs 1 slots
2013-10-31 18:36:04,624 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000000_0 which needs 1 slots
2013-10-31 18:36:04,625 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:04,625 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:04,625 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:04,625 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_1768967875 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:04,625 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:36:04,626 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000001_0 which needs 1 slots
2013-10-31 18:36:04,627 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000001_0 which needs 1 slots
2013-10-31 18:36:04,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken	dst=null	perm=null
2013-10-31 18:36:04,632 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43615, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8125310525460418873_1195, duration: 148052
2013-10-31 18:36:04,634 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000002_0' to tip task_20131031182606197_0019_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:36:04,635 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000002
2013-10-31 18:36:04,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=null
2013-10-31 18:36:04,636 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:36:04,636 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000002_0 which needs 1 slots
2013-10-31 18:36:04,636 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000002_0 which needs 1 slots
2013-10-31 18:36:04,637 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47508, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-68063591, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3017248074108405270_1192, duration: 177898
2013-10-31 18:36:04,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken	dst=null	perm=null
2013-10-31 18:36:04,641 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47792, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8125310525460418873_1195, duration: 308124
2013-10-31 18:36:04,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=null
2013-10-31 18:36:04,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50423, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-2136551949, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3017248074108405270_1192, duration: 538340
2013-10-31 18:36:04,657 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:04,661 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:04,665 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_1949184114
2013-10-31 18:36:04,666 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_1949184114 spawned.
2013-10-31 18:36:04,667 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000000_0/taskjvm.sh
2013-10-31 18:36:04,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=null
2013-10-31 18:36:04,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=null
2013-10-31 18:36:04,677 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50424, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-68063591, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3901584568493252230_1189, duration: 641758
2013-10-31 18:36:04,677 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43622, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2136551949, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3901584568493252230_1189, duration: 644852
2013-10-31 18:36:04,781 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_-1043381516
2013-10-31 18:36:04,781 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_112423469
2013-10-31 18:36:04,782 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_-1043381516 spawned.
2013-10-31 18:36:04,783 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_112423469 spawned.
2013-10-31 18:36:04,786 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000002_0/taskjvm.sh
2013-10-31 18:36:04,786 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000001_0/taskjvm.sh
2013-10-31 18:36:04,815 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000003_0' to tip task_20131031182606197_0019_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:36:04,815 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000003
2013-10-31 18:36:04,817 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:36:04,818 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000003_0 which needs 1 slots
2013-10-31 18:36:04,818 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000003_0 which needs 1 slots
2013-10-31 18:36:04,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken	dst=null	perm=null
2013-10-31 18:36:04,827 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43623, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8125310525460418873_1195, duration: 290308
2013-10-31 18:36:04,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml	dst=null	perm=null
2013-10-31 18:36:04,837 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47799, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-587080131, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3017248074108405270_1192, duration: 383697
2013-10-31 18:36:04,867 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:04,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar	dst=null	perm=null
2013-10-31 18:36:04,889 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50429, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-587080131, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3901584568493252230_1189, duration: 599154
2013-10-31 18:36:05,615 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_1949184114 given task: attempt_20131031182606197_0019_m_000000_0
2013-10-31 18:36:06,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=null
2013-10-31 18:36:06,138 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50432, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5772430696144033641_1190, duration: 166222
2013-10-31 18:36:06,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:06,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50433, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 256752
2013-10-31 18:36:06,400 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-4435351282615346343_1046
2013-10-31 18:36:06,418 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_-2097867249
2013-10-31 18:36:06,420 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_-2097867249 spawned.
2013-10-31 18:36:06,422 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000003_0/taskjvm.sh
2013-10-31 18:36:07,134 INFO  mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031182606197_0019_m_000000_0 is 2512 ms debug.
2013-10-31 18:36:07,218 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_-1043381516 given task: attempt_20131031182606197_0019_m_000002_0
2013-10-31 18:36:07,229 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_112423469 given task: attempt_20131031182606197_0019_m_000001_0
2013-10-31 18:36:07,395 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_-2097867249 given task: attempt_20131031182606197_0019_m_000003_0
2013-10-31 18:36:07,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=null
2013-10-31 18:36:07,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43636, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5772430696144033641_1190, duration: 174016
2013-10-31 18:36:07,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=null
2013-10-31 18:36:07,722 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47811, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5772430696144033641_1190, duration: 143003
2013-10-31 18:36:07,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:07,752 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47529, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 144634
2013-10-31 18:36:07,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:07,893 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:36:07,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split	dst=null	perm=null
2013-10-31 18:36:07,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43640, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5772430696144033641_1190, duration: 123898
2013-10-31 18:36:07,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:07,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50444, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 158283
2013-10-31 18:36:08,018 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47816, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 189351
2013-10-31 18:36:09,047 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:36:09,050 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000000_0 is done.
2013-10-31 18:36:09,050 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000000_0  was 62
2013-10-31 18:36:09,050 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:09,624 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0019_m_000005_0
2013-10-31 18:36:09,625 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0019_m_000005_0
2013-10-31 18:36:09,625 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0019_m_000005_0 not found in cache
2013-10-31 18:36:10,629 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000000_0' has completed task_20131031182606197_0019_m_000000 successfully.
2013-10-31 18:36:10,631 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0019_r_000000_0' to tip task_20131031182606197_0019_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:10,633 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:10,634 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_r_000000_0 which needs 1 slots
2013-10-31 18:36:10,634 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_r_000000_0 which needs 1 slots
2013-10-31 18:36:10,657 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:36:10,661 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000002_0 is done.
2013-10-31 18:36:10,661 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000002_0  was 85
2013-10-31 18:36:10,662 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:10,662 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:36:10,667 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000001_0 is done.
2013-10-31 18:36:10,667 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000001_0  was 83
2013-10-31 18:36:10,669 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:10,691 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_r_-1747545474
2013-10-31 18:36:10,691 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_r_-1747545474 spawned.
2013-10-31 18:36:10,694 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_r_000000_0/taskjvm.sh
2013-10-31 18:36:10,826 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:36:10,829 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000003_0 is done.
2013-10-31 18:36:10,829 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000003_0  was 61
2013-10-31 18:36:10,829 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:11,774 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_r_-1747545474 given task: attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:13,637 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000001_0' has completed task_20131031182606197_0019_m_000001 successfully.
2013-10-31 18:36:13,662 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000002_0' has completed task_20131031182606197_0019_m_000002 successfully.
2013-10-31 18:36:13,824 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000003_0' has completed task_20131031182606197_0019_m_000003 successfully.
2013-10-31 18:36:17,437 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44528, bytes: 62, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000000_0, duration: 6238920
2013-10-31 18:36:17,453 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39832, bytes: 83, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000001_0, duration: 10369030
2013-10-31 18:36:17,469 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49488, bytes: 85, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000002_0, duration: 11446221
2013-10-31 18:36:17,486 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41855, bytes: 61, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000003_0, duration: 12092711
2013-10-31 18:36:18,249 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:18,299 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:18,357 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:18,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:18,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:18,594 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000. blk_-8039349918214939140_1196
2013-10-31 18:36:18,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8039349918214939140_1196 src: /127.0.0.1:43651 dest: /127.0.0.1:59471
2013-10-31 18:36:18,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8039349918214939140_1196 src: /127.0.0.1:47826 dest: /127.0.0.1:54365
2013-10-31 18:36:18,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8039349918214939140_1196 src: /127.0.0.1:47544 dest: /127.0.0.1:37740
2013-10-31 18:36:18,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47544, dest: /127.0.0.1:37740, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0019_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8039349918214939140_1196, duration: 1691475
2013-10-31 18:36:18,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8039349918214939140_1196 terminating
2013-10-31 18:36:18,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47826, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0019_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8039349918214939140_1196, duration: 2638767
2013-10-31 18:36:18,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8039349918214939140_1196 terminating
2013-10-31 18:36:18,632 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43651, dest: /127.0.0.1:59471, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0019_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8039349918214939140_1196, duration: 3104677
2013-10-31 18:36:18,632 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8039349918214939140_1196 terminating
2013-10-31 18:36:18,634 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8039349918214939140_1196 size 128
2013-10-31 18:36:18,635 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:18,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:18,635 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8039349918214939140_1196 size 128
2013-10-31 18:36:18,636 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8039349918214939140_1196 size 128
2013-10-31 18:36:18,670 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0019_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:36:18,670 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:19,643 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0019_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:36:19,644 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:19,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0	dst=null	perm=null
2013-10-31 18:36:19,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:19,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:19,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0	dst=null	perm=null
2013-10-31 18:36:21,301 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:21,302 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:21,303 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_r_000000_0 is done.
2013-10-31 18:36:21,303 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_r_000000_0  was -1
2013-10-31 18:36:21,304 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:22,648 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_r_000000_0' has completed task_20131031182606197_0019_r_000000 successfully.
2013-10-31 18:36:22,653 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0019_m_000004_0' to tip task_20131031182606197_0019_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:22,655 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:36:22,655 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000004_0 which needs 1 slots
2013-10-31 18:36:22,656 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000004_0 which needs 1 slots
2013-10-31 18:36:22,689 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0019/attempt_20131031182606197_0019_m_000004_0. Attempting to reuse: jvm_20131031182606197_0019_m_1949184114
2013-10-31 18:36:23,130 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_1949184114 given task: attempt_20131031182606197_0019_m_000004_0
2013-10-31 18:36:23,264 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000004_0 0.0% 
2013-10-31 18:36:23,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary	dst=null	perm=null
2013-10-31 18:36:23,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:23,279 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_SUCCESS from client DFSClient_attempt_20131031182606197_0019_m_000004_0
2013-10-31 18:36:23,279 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0019_m_000004_0
2013-10-31 18:36:23,283 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:23,283 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:23,283 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,283 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,284 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:23,284 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,284 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,284 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:23,284 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7894420003126651925 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,284 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7894420003126651925 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:23,285 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7894420003126651925 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,285 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3017248074108405270 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,285 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3017248074108405270 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,285 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3017248074108405270 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:23,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019	dst=null	perm=null
2013-10-31 18:36:25,475 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-3901584568493252230_1189 blk_-7894420003126651925_1191 blk_-5772430696144033641_1190
2013-10-31 18:36:25,475 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-3901584568493252230_1189 blk_-7894420003126651925_1191 blk_-5772430696144033641_1190 blk_3017248074108405270_1192
2013-10-31 18:36:26,215 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000004_0 0.0% cleanup
2013-10-31 18:36:26,217 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000004_0 is done.
2013-10-31 18:36:26,217 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000004_0  was -1
2013-10-31 18:36:26,217 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7894420003126651925_1191 file build/test/data/dfs/data/data6/current/blk_-7894420003126651925 for deletion
2013-10-31 18:36:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data5/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7894420003126651925_1191 at file build/test/data/dfs/data/data6/current/blk_-7894420003126651925
2013-10-31 18:36:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data6/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:26,837 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data5/current/blk_-5772430696144033641
2013-10-31 18:36:26,838 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data6/current/blk_-3901584568493252230
2013-10-31 18:36:27,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7894420003126651925_1191 file build/test/data/dfs/data/data7/current/blk_-7894420003126651925 for deletion
2013-10-31 18:36:27,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data8/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:27,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7894420003126651925_1191 at file build/test/data/dfs/data/data7/current/blk_-7894420003126651925
2013-10-31 18:36:27,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data8/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:27,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data8/current/blk_-5772430696144033641
2013-10-31 18:36:27,308 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3017248074108405270_1192 file build/test/data/dfs/data/data8/current/blk_3017248074108405270 for deletion
2013-10-31 18:36:27,308 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data8/current/blk_-3901584568493252230
2013-10-31 18:36:27,309 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3017248074108405270_1192 at file build/test/data/dfs/data/data8/current/blk_3017248074108405270
2013-10-31 18:36:27,656 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:27,656 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:28,476 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-3901584568493252230_1189 blk_-7894420003126651925_1191 blk_-5772430696144033641_1190 blk_3017248074108405270_1192
2013-10-31 18:36:28,476 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-3901584568493252230_1189 blk_-5772430696144033641_1190 blk_3017248074108405270_1192
2013-10-31 18:36:28,663 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000004_0' has completed task_20131031182606197_0019_m_000004 successfully.
2013-10-31 18:36:28,664 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0019 has completed successfully.
2013-10-31 18:36:28,664 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0019,submitTime=1383244556666,launchTime=1383244556990,firstMapTaskLaunchTime=1383244564620,firstReduceTaskLaunchTime=1383244570631,firstJobSetupTaskLaunchTime=1383244558603,firstJobCleanupTaskLaunchTime=1383244582652,finishTime=1383244588664,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[BED69F8FF7F34812A12665BA81CD7B25/BF10BB85030C48EDBB8D74F68D5A2154] test/(1/1) ...fieldedpipesplatform/none
2013-10-31 18:36:28,670 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED. blk_6752359892383718101_1197
2013-10-31 18:36:28,674 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6752359892383718101_1197 src: /127.0.0.1:43656 dest: /127.0.0.1:59471
2013-10-31 18:36:28,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6752359892383718101_1197 src: /127.0.0.1:47831 dest: /127.0.0.1:54365
2013-10-31 18:36:28,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6752359892383718101_1197 src: /127.0.0.1:47549 dest: /127.0.0.1:37740
2013-10-31 18:36:28,686 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47549, dest: /127.0.0.1:37740, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6752359892383718101_1197, duration: 2359466
2013-10-31 18:36:28,687 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6752359892383718101_1197 terminating
2013-10-31 18:36:28,687 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47831, dest: /127.0.0.1:54365, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6752359892383718101_1197, duration: 3821832
2013-10-31 18:36:28,688 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6752359892383718101_1197 terminating
2013-10-31 18:36:28,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43656, dest: /127.0.0.1:59471, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6752359892383718101_1197, duration: 4960328
2013-10-31 18:36:28,689 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6752359892383718101_1197 size 28304
2013-10-31 18:36:28,689 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6752359892383718101_1197 terminating
2013-10-31 18:36:28,692 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED from client DFSClient_-813892404
2013-10-31 18:36:28,692 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED is closed by DFSClient_-813892404
2013-10-31 18:36:28,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6752359892383718101_1197 size 28304
2013-10-31 18:36:28,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6752359892383718101_1197 size 28304
2013-10-31 18:36:28,705 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:36:28,706 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000000_0'
2013-10-31 18:36:28,706 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000004_0'
2013-10-31 18:36:28,710 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8125310525460418873 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:28,710 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000005_0'
2013-10-31 18:36:28,710 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8125310525460418873 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:28,710 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_r_000000_0'
2013-10-31 18:36:28,711 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8125310525460418873 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:28,711 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000002_0'
2013-10-31 18:36:28,712 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000001_0'
2013-10-31 18:36:28,714 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0019_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:36:28,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019	dst=null	perm=null
2013-10-31 18:36:28,719 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary
2013-10-31 18:36:28,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none	dst=null	perm=null
2013-10-31 18:36:28,739 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:36:28,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000	dst=null	perm=null
2013-10-31 18:36:28,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000	dst=null	perm=null
2013-10-31 18:36:28,744 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47834, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8039349918214939140_1196, duration: 287588
2013-10-31 18:36:28,745 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/none
2013-10-31 18:36:28,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none	dst=null	perm=null
2013-10-31 18:36:28,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000	dst=null	perm=null
2013-10-31 18:36:28,751 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47552, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8039349918214939140_1196, duration: 316407
2013-10-31 18:36:28,758 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:36:28,759 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:36:28,770 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:36:28,771 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:36:28,771 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->['count', 'ipaddress']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap"]
2013-10-31 18:36:28,772 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:36:28,772 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:36:28,772 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:36:28,775 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...fieldedpipesplatform/swap
2013-10-31 18:36:28,777 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:36:28,777 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:36:28,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:28,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:36:28,841 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000003_0'
2013-10-31 18:36:28,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,939 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar. blk_-2889835826154294416_1198
2013-10-31 18:36:28,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:47836 dest: /127.0.0.1:54365
2013-10-31 18:36:28,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:43663 dest: /127.0.0.1:59471
2013-10-31 18:36:28,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:50467 dest: /127.0.0.1:34578
2013-10-31 18:36:28,954 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50467, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2889835826154294416_1198, duration: 6606640
2013-10-31 18:36:28,955 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2889835826154294416_1198 terminating
2013-10-31 18:36:28,955 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43663, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2889835826154294416_1198, duration: 7827708
2013-10-31 18:36:28,956 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2889835826154294416_1198 terminating
2013-10-31 18:36:28,956 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:28,956 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47836, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2889835826154294416_1198, duration: 8495425
2013-10-31 18:36:28,957 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2889835826154294416_1198 terminating
2013-10-31 18:36:28,959 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:28,959 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar from client DFSClient_-1596270109
2013-10-31 18:36:28,960 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:36:28,960 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:28,964 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar. New replication is 10
2013-10-31 18:36:28,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=null
2013-10-31 18:36:28,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,974 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:36:28,979 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:36:28,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:28,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,994 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split. New replication is 10
2013-10-31 18:36:28,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=null
2013-10-31 18:36:29,001 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split. blk_-7715455870848698122_1199
2013-10-31 18:36:29,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:50468 dest: /127.0.0.1:34578
2013-10-31 18:36:29,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:47840 dest: /127.0.0.1:54365
2013-10-31 18:36:29,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:43667 dest: /127.0.0.1:59471
2013-10-31 18:36:29,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:47559 dest: /127.0.0.1:37740
2013-10-31 18:36:29,010 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47559, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7715455870848698122_1199, duration: 115424
2013-10-31 18:36:29,011 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43667, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7715455870848698122_1199, duration: 971127
2013-10-31 18:36:29,012 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,012 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47840, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7715455870848698122_1199, duration: 1870526
2013-10-31 18:36:29,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50468, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7715455870848698122_1199, duration: 2684174
2013-10-31 18:36:29,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,016 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,016 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split from client DFSClient_-1596270109
2013-10-31 18:36:29,017 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split is closed by DFSClient_-1596270109
2013-10-31 18:36:29,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,036 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo. blk_-7275852970796318644_1200
2013-10-31 18:36:29,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275852970796318644_1200 src: /127.0.0.1:43669 dest: /127.0.0.1:59471
2013-10-31 18:36:29,039 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275852970796318644_1200 src: /127.0.0.1:50473 dest: /127.0.0.1:34578
2013-10-31 18:36:29,040 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275852970796318644_1200 src: /127.0.0.1:47845 dest: /127.0.0.1:54365
2013-10-31 18:36:29,043 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47845, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7275852970796318644_1200, duration: 88292
2013-10-31 18:36:29,044 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7275852970796318644_1200 terminating
2013-10-31 18:36:29,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50473, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7275852970796318644_1200, duration: 918844
2013-10-31 18:36:29,045 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7275852970796318644_1200 terminating
2013-10-31 18:36:29,045 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7275852970796318644_1200 size 156
2013-10-31 18:36:29,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43669, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7275852970796318644_1200, duration: 1746171
2013-10-31 18:36:29,046 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7275852970796318644_1200 terminating
2013-10-31 18:36:29,049 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7275852970796318644_1200 size 156
2013-10-31 18:36:29,049 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:36:29,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:36:29,050 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7275852970796318644_1200 size 156
2013-10-31 18:36:29,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,071 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml. blk_-1742899109407851518_1201
2013-10-31 18:36:29,073 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1742899109407851518_1201 src: /127.0.0.1:43672 dest: /127.0.0.1:59471
2013-10-31 18:36:29,074 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1742899109407851518_1201 src: /127.0.0.1:50476 dest: /127.0.0.1:34578
2013-10-31 18:36:29,076 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1742899109407851518_1201 src: /127.0.0.1:47565 dest: /127.0.0.1:37740
2013-10-31 18:36:29,079 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47565, dest: /127.0.0.1:37740, bytes: 28159, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 331354
2013-10-31 18:36:29,079 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1742899109407851518_1201 terminating
2013-10-31 18:36:29,079 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50476, dest: /127.0.0.1:34578, bytes: 28159, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1742899109407851518_1201, duration: 1213721
2013-10-31 18:36:29,080 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1742899109407851518_1201 size 28159
2013-10-31 18:36:29,080 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1742899109407851518_1201 terminating
2013-10-31 18:36:29,080 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43672, dest: /127.0.0.1:59471, bytes: 28159, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1742899109407851518_1201, duration: 2114201
2013-10-31 18:36:29,080 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1742899109407851518_1201 size 28159
2013-10-31 18:36:29,081 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1742899109407851518_1201 terminating
2013-10-31 18:36:29,082 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1742899109407851518_1201 size 28159
2013-10-31 18:36:29,083 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml from client DFSClient_-1596270109
2013-10-31 18:36:29,083 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:36:29,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=null
2013-10-31 18:36:29,098 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47567, bytes: 28379, op: HDFS_READ, cliID: DFSClient_-791702297, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 409408
2013-10-31 18:36:29,116 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0020: nMaps=4 nReduces=1 max=-1
2013-10-31 18:36:29,116 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0020 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:36:29,116 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0020
2013-10-31 18:36:29,117 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0020	RESULT=SUCCESS
2013-10-31 18:36:29,117 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0020
2013-10-31 18:36:29,118 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0020
2013-10-31 18:36:29,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,147 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data3/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:29,147 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data4/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:29,147 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data3/current/blk_-5772430696144033641
2013-10-31 18:36:29,148 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3017248074108405270_1192 file build/test/data/dfs/data/data4/current/blk_3017248074108405270 for deletion
2013-10-31 18:36:29,148 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data4/current/blk_-3901584568493252230
2013-10-31 18:36:29,148 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3017248074108405270_1192 at file build/test/data/dfs/data/data4/current/blk_3017248074108405270
2013-10-31 18:36:29,150 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml. blk_1218262851856022493_1203
2013-10-31 18:36:29,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1218262851856022493_1203 src: /127.0.0.1:47568 dest: /127.0.0.1:37740
2013-10-31 18:36:29,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1218262851856022493_1203 src: /127.0.0.1:47852 dest: /127.0.0.1:54365
2013-10-31 18:36:29,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1218262851856022493_1203 src: /127.0.0.1:50482 dest: /127.0.0.1:34578
2013-10-31 18:36:29,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50482, dest: /127.0.0.1:34578, bytes: 28224, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1218262851856022493_1203, duration: 557765
2013-10-31 18:36:29,160 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1218262851856022493_1203 terminating
2013-10-31 18:36:29,160 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1218262851856022493_1203 size 28224
2013-10-31 18:36:29,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47852, dest: /127.0.0.1:54365, bytes: 28224, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1218262851856022493_1203, duration: 1488872
2013-10-31 18:36:29,161 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1218262851856022493_1203 terminating
2013-10-31 18:36:29,161 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47568, dest: /127.0.0.1:37740, bytes: 28224, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1218262851856022493_1203, duration: 2537572
2013-10-31 18:36:29,162 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1218262851856022493_1203 terminating
2013-10-31 18:36:29,164 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml from client DFSClient_-791702297
2013-10-31 18:36:29,164 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml is closed by DFSClient_-791702297
2013-10-31 18:36:29,165 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1218262851856022493_1203 size 28224
2013-10-31 18:36:29,166 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1218262851856022493_1203 size 28224
2013-10-31 18:36:29,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,793 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken. blk_2967099774717268511_1204
2013-10-31 18:36:29,795 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2967099774717268511_1204 src: /127.0.0.1:47571 dest: /127.0.0.1:37740
2013-10-31 18:36:29,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2967099774717268511_1204 src: /127.0.0.1:43681 dest: /127.0.0.1:59471
2013-10-31 18:36:29,798 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2967099774717268511_1204 src: /127.0.0.1:50485 dest: /127.0.0.1:34578
2013-10-31 18:36:29,801 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50485, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2967099774717268511_1204, duration: 70496
2013-10-31 18:36:29,802 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2967099774717268511_1204 terminating
2013-10-31 18:36:29,802 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2967099774717268511_1204 size 116
2013-10-31 18:36:29,802 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43681, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2967099774717268511_1204, duration: 920126
2013-10-31 18:36:29,803 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2967099774717268511_1204 terminating
2013-10-31 18:36:29,803 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47571, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2967099774717268511_1204, duration: 2033647
2013-10-31 18:36:29,804 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2967099774717268511_1204 terminating
2013-10-31 18:36:29,806 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2967099774717268511_1204 size 116
2013-10-31 18:36:29,806 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken from client DFSClient_-1596270109
2013-10-31 18:36:29,807 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:36:29,807 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2967099774717268511_1204 size 116
2013-10-31 18:36:29,811 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken
2013-10-31 18:36:29,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:36:29,815 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43683, bytes: 160, op: HDFS_READ, cliID: DFSClient_-791702297, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7275852970796318644_1200, duration: 274678
2013-10-31 18:36:29,816 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0020 = 1449. Number of splits = 4
2013-10-31 18:36:29,816 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0020 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:36:29,820 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0020 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:36:30,234 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7894420003126651925_1191 file build/test/data/dfs/data/data2/current/blk_-7894420003126651925 for deletion
2013-10-31 18:36:30,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data1/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:30,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data2/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:30,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7894420003126651925_1191 at file build/test/data/dfs/data/data2/current/blk_-7894420003126651925
2013-10-31 18:36:30,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data1/current/blk_-5772430696144033641
2013-10-31 18:36:30,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3017248074108405270_1192 file build/test/data/dfs/data/data1/current/blk_3017248074108405270 for deletion
2013-10-31 18:36:30,235 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data2/current/blk_-3901584568493252230
2013-10-31 18:36:30,236 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3017248074108405270_1192 at file build/test/data/dfs/data/data1/current/blk_3017248074108405270
2013-10-31 18:36:31,477 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-2889835826154294416_1198 to datanode(s) 127.0.0.1:37740
2013-10-31 18:36:31,477 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_8125310525460418873_1195
2013-10-31 18:36:31,478 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_8125310525460418873_1195
2013-10-31 18:36:31,718 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0020_m_000005_0' to tip task_20131031182606197_0020_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:31,729 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:36:31,729 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000005_0 which needs 1 slots
2013-10-31 18:36:31,729 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000005_0 which needs 1 slots
2013-10-31 18:36:31,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken	dst=null	perm=null
2013-10-31 18:36:31,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43684, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2967099774717268511_1204, duration: 315293
2013-10-31 18:36:31,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=null
2013-10-31 18:36:31,748 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50489, bytes: 28379, op: HDFS_READ, cliID: DFSClient_28430789, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1742899109407851518_1201, duration: 389213
2013-10-31 18:36:31,775 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:31,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=null
2013-10-31 18:36:31,808 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50490, bytes: 239915, op: HDFS_READ, cliID: DFSClient_28430789, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2889835826154294416_1198, duration: 1424286
2013-10-31 18:36:31,902 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0019_m_-570022639
2013-10-31 18:36:31,909 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26994 with signal TERM. Exit code 0
2013-10-31 18:36:31,910 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-1374561285
2013-10-31 18:36:31,911 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-1374561285 spawned.
2013-10-31 18:36:31,912 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000005_0/taskjvm.sh
2013-10-31 18:36:32,433 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:32,433 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:32,433 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:32,434 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_-570022639 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:32,838 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-2889835826154294416_1198 to 127.0.0.1:37740 
2013-10-31 18:36:32,838 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8125310525460418873_1195 file build/test/data/dfs/data/data6/current/blk_8125310525460418873 for deletion
2013-10-31 18:36:32,839 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8125310525460418873_1195 at file build/test/data/dfs/data/data6/current/blk_8125310525460418873
2013-10-31 18:36:32,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:47579 dest: /127.0.0.1:37740
2013-10-31 18:36:32,839 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-2889835826154294416_1198 to /127.0.0.1:37740
2013-10-31 18:36:32,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2889835826154294416_1198 src: /127.0.0.1:47579 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:36:32,841 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:33,237 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8125310525460418873_1195 file build/test/data/dfs/data/data2/current/blk_8125310525460418873 for deletion
2013-10-31 18:36:33,237 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8125310525460418873_1195 at file build/test/data/dfs/data/data2/current/blk_8125310525460418873
2013-10-31 18:36:33,252 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-1374561285 given task: attempt_20131031182606197_0020_m_000005_0
2013-10-31 18:36:33,712 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,712 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0019_m_000004_0 not found in cache
2013-10-31 18:36:33,712 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,713 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993713
2013-10-31 18:36:33,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993713
2013-10-31 18:36:33,713 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993713
2013-10-31 18:36:33,759 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1073 Total time for transactions(ms): 25Number of transactions batched in Syncs: 98 Number of syncs: 739 SyncTimes(ms): 60872 13455 
2013-10-31 18:36:33,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:33,842 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,842 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993842
2013-10-31 18:36:33,843 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_r_-1747545474 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,853 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27444 with signal TERM. Exit code 0
2013-10-31 18:36:33,897 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_112423469 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,902 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27255 with signal TERM. Exit code 0
2013-10-31 18:36:33,917 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_-1043381516 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,921 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27256 with signal TERM. Exit code 0
2013-10-31 18:36:33,954 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_-2097867249 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,960 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27326 with signal TERM. Exit code 0
2013-10-31 18:36:34,022 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,022 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,022 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:34,022 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_r_-1747545474 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,115 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,115 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,115 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:34,115 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_112423469 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,123 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,124 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,124 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:34,124 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_-1043381516 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,188 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,188 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,188 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:34,188 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_-2097867249 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,253 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_1949184114 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:34,263 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27176 with signal TERM. Exit code 0
2013-10-31 18:36:34,447 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,447 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,447 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:36:34,447 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_1949184114 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:36:34,479 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_8125310525460418873_1195
2013-10-31 18:36:35,111 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8125310525460418873_1195 file build/test/data/dfs/data/data4/current/blk_8125310525460418873 for deletion
2013-10-31 18:36:35,111 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8125310525460418873_1195 at file build/test/data/dfs/data/data4/current/blk_8125310525460418873
2013-10-31 18:36:36,683 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000005_0 0.0% setup
2013-10-31 18:36:36,686 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000005_0 is done.
2013-10-31 18:36:36,686 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000005_0  was -1
2013-10-31 18:36:36,686 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:37,735 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000005_0' has completed task_20131031182606197_0020_m_000005 successfully.
2013-10-31 18:36:37,740 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000000_0' to tip task_20131031182606197_0020_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:37,743 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000000
2013-10-31 18:36:37,746 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000001_0' to tip task_20131031182606197_0020_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:36:37,748 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:37,749 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000001
2013-10-31 18:36:37,749 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000000_0 which needs 1 slots
2013-10-31 18:36:37,749 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000000_0 which needs 1 slots
2013-10-31 18:36:37,751 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:36:37,752 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000001_0 which needs 1 slots
2013-10-31 18:36:37,752 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000001_0 which needs 1 slots
2013-10-31 18:36:37,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken	dst=null	perm=null
2013-10-31 18:36:37,761 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43694, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2967099774717268511_1204, duration: 319098
2013-10-31 18:36:37,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=null
2013-10-31 18:36:37,772 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000002_0' to tip task_20131031182606197_0020_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:36:37,773 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000002
2013-10-31 18:36:37,773 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47587, bytes: 28379, op: HDFS_READ, cliID: DFSClient_547673069, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 397874
2013-10-31 18:36:37,775 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:36:37,775 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000002_0 which needs 1 slots
2013-10-31 18:36:37,776 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000002_0 which needs 1 slots
2013-10-31 18:36:37,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken	dst=null	perm=null
2013-10-31 18:36:37,784 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50500, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2967099774717268511_1204, duration: 436210
2013-10-31 18:36:37,788 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_394041626
2013-10-31 18:36:37,789 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_394041626 spawned.
2013-10-31 18:36:37,790 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000000_0/taskjvm.sh
2013-10-31 18:36:37,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=null
2013-10-31 18:36:37,796 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47590, bytes: 28379, op: HDFS_READ, cliID: DFSClient_-840794698, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 187903
2013-10-31 18:36:37,800 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:37,826 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:37,849 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000003_0' to tip task_20131031182606197_0020_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:36:37,850 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000003
2013-10-31 18:36:37,852 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:36:37,852 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000003_0 which needs 1 slots
2013-10-31 18:36:37,852 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000003_0 which needs 1 slots
2013-10-31 18:36:37,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken	dst=null	perm=null
2013-10-31 18:36:37,921 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50503, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2967099774717268511_1204, duration: 306451
2013-10-31 18:36:37,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=null
2013-10-31 18:36:37,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml	dst=null	perm=null
2013-10-31 18:36:37,931 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47593, bytes: 239915, op: HDFS_READ, cliID: DFSClient_547673069, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2889835826154294416_1198, duration: 1572814
2013-10-31 18:36:37,932 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47594, bytes: 28379, op: HDFS_READ, cliID: DFSClient_1666280287, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 423299
2013-10-31 18:36:37,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=null
2013-10-31 18:36:37,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50507, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-840794698, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2889835826154294416_1198, duration: 1631607
2013-10-31 18:36:37,962 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:37,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar	dst=null	perm=null
2013-10-31 18:36:37,977 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47596, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1666280287, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2889835826154294416_1198, duration: 645237
2013-10-31 18:36:38,012 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-873425933
2013-10-31 18:36:38,013 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-873425933 spawned.
2013-10-31 18:36:38,015 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000001_0/taskjvm.sh
2013-10-31 18:36:38,023 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-614092363
2013-10-31 18:36:38,023 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-614092363 spawned.
2013-10-31 18:36:38,025 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000002_0/taskjvm.sh
2013-10-31 18:36:38,049 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-1210448733
2013-10-31 18:36:38,049 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-1210448733 spawned.
2013-10-31 18:36:38,052 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000003_0/taskjvm.sh
2013-10-31 18:36:38,894 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_394041626 given task: attempt_20131031182606197_0020_m_000000_0
2013-10-31 18:36:39,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=null
2013-10-31 18:36:39,437 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43708, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7715455870848698122_1199, duration: 168586
2013-10-31 18:36:39,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:39,477 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47600, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 135760
2013-10-31 18:36:39,915 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-1210448733 given task: attempt_20131031182606197_0020_m_000003_0
2013-10-31 18:36:39,925 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-873425933 given task: attempt_20131031182606197_0020_m_000001_0
2013-10-31 18:36:39,933 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-614092363 given task: attempt_20131031182606197_0020_m_000002_0
2013-10-31 18:36:40,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=null
2013-10-31 18:36:40,429 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50519, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7715455870848698122_1199, duration: 121380
2013-10-31 18:36:40,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=null
2013-10-31 18:36:40,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47891, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7715455870848698122_1199, duration: 141296
2013-10-31 18:36:40,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split	dst=null	perm=null
2013-10-31 18:36:40,454 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50521, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7715455870848698122_1199, duration: 168933
2013-10-31 18:36:40,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:40,469 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47893, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 146352
2013-10-31 18:36:40,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:40,480 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47611, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 139379
2013-10-31 18:36:40,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:36:40,744 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50524, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 185945
2013-10-31 18:36:42,363 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:36:42,366 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000000_0 is done.
2013-10-31 18:36:42,366 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000000_0  was 62
2013-10-31 18:36:42,367 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:42,749 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0020_m_000005_0
2013-10-31 18:36:42,749 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0020_m_000005_0
2013-10-31 18:36:42,750 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0020_m_000005_0 not found in cache
2013-10-31 18:36:43,359 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:36:43,363 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000003_0 is done.
2013-10-31 18:36:43,364 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000003_0  was 61
2013-10-31 18:36:43,364 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:43,370 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:36:43,372 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000002_0 is done.
2013-10-31 18:36:43,372 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000002_0  was 85
2013-10-31 18:36:43,372 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:43,383 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:36:43,384 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000001_0 is done.
2013-10-31 18:36:43,384 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000001_0  was 83
2013-10-31 18:36:43,385 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:43,751 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000000_0' has completed task_20131031182606197_0020_m_000000 successfully.
2013-10-31 18:36:43,754 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0020_r_000000_0' to tip task_20131031182606197_0020_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:43,757 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:43,757 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_r_000000_0 which needs 1 slots
2013-10-31 18:36:43,757 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000001_0' has completed task_20131031182606197_0020_m_000001 successfully.
2013-10-31 18:36:43,757 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_r_000000_0 which needs 1 slots
2013-10-31 18:36:43,780 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000002_0' has completed task_20131031182606197_0020_m_000002 successfully.
2013-10-31 18:36:43,791 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_r_606975538
2013-10-31 18:36:43,791 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_r_606975538 spawned.
2013-10-31 18:36:43,794 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_r_000000_0/taskjvm.sh
2013-10-31 18:36:43,857 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000003_0' has completed task_20131031182606197_0020_m_000003 successfully.
2013-10-31 18:36:45,335 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_r_606975538 given task: attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:51,022 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44606, bytes: 62, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000000_0, duration: 5878193
2013-10-31 18:36:51,039 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49565, bytes: 83, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000001_0, duration: 9433385
2013-10-31 18:36:51,056 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39911, bytes: 85, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000002_0, duration: 12009479
2013-10-31 18:36:51,072 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41933, bytes: 61, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000003_0, duration: 12010657
2013-10-31 18:36:51,816 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:51,889 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:51,941 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:52,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:52,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:52,173 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000. blk_-713045408687538439_1205
2013-10-31 18:36:52,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-713045408687538439_1205 src: /127.0.0.1:43729 dest: /127.0.0.1:59471
2013-10-31 18:36:52,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-713045408687538439_1205 src: /127.0.0.1:47904 dest: /127.0.0.1:54365
2013-10-31 18:36:52,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-713045408687538439_1205 src: /127.0.0.1:50534 dest: /127.0.0.1:34578
2013-10-31 18:36:52,205 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50534, dest: /127.0.0.1:34578, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0020_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-713045408687538439_1205, duration: 1547049
2013-10-31 18:36:52,205 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-713045408687538439_1205 terminating
2013-10-31 18:36:52,206 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47904, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0020_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-713045408687538439_1205, duration: 5160934
2013-10-31 18:36:52,206 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-713045408687538439_1205 terminating
2013-10-31 18:36:52,206 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43729, dest: /127.0.0.1:59471, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0020_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-713045408687538439_1205, duration: 5671673
2013-10-31 18:36:52,207 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-713045408687538439_1205 terminating
2013-10-31 18:36:52,208 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-713045408687538439_1205 size 128
2013-10-31 18:36:52,208 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:52,209 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:52,209 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-713045408687538439_1205 size 128
2013-10-31 18:36:52,209 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-713045408687538439_1205 size 128
2013-10-31 18:36:52,245 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0020_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:36:52,245 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:52,767 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0020_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:36:52,768 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:53,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0	dst=null	perm=null
2013-10-31 18:36:53,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:53,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:53,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0	dst=null	perm=null
2013-10-31 18:36:54,863 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:54,865 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:54,866 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_r_000000_0 is done.
2013-10-31 18:36:54,866 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_r_000000_0  was -1
2013-10-31 18:36:54,866 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:55,772 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_r_000000_0' has completed task_20131031182606197_0020_r_000000 successfully.
2013-10-31 18:36:55,777 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0020_m_000004_0' to tip task_20131031182606197_0020_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:55,779 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:36:55,779 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000004_0 which needs 1 slots
2013-10-31 18:36:55,780 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000004_0 which needs 1 slots
2013-10-31 18:36:55,800 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0020/attempt_20131031182606197_0020_m_000004_0. Attempting to reuse: jvm_20131031182606197_0020_m_-1374561285
2013-10-31 18:36:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:36:56,023 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,034 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,039 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,045 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,050 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,050 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:36:56,764 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-1374561285 given task: attempt_20131031182606197_0020_m_000004_0
2013-10-31 18:36:56,867 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000004_0 0.0% 
2013-10-31 18:36:56,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary	dst=null	perm=null
2013-10-31 18:36:56,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:56,891 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_SUCCESS from client DFSClient_attempt_20131031182606197_0020_m_000004_0
2013-10-31 18:36:56,892 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0020_m_000004_0
2013-10-31 18:36:56,898 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,898 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,898 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:56,898 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:56,898 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:56,898 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275852970796318644 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275852970796318644 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275852970796318644 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1742899109407851518 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,899 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1742899109407851518 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:56,900 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1742899109407851518 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020	dst=null	perm=null
2013-10-31 18:36:58,483 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-7275852970796318644_1200
2013-10-31 18:36:58,483 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-7275852970796318644_1200 blk_-1742899109407851518_1201
2013-10-31 18:36:59,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data4/current/blk_-7715455870848698122 for deletion
2013-10-31 18:36:59,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275852970796318644_1200 file build/test/data/dfs/data/data3/current/blk_-7275852970796318644 for deletion
2013-10-31 18:36:59,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data4/current/blk_-7715455870848698122
2013-10-31 18:36:59,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275852970796318644_1200 at file build/test/data/dfs/data/data3/current/blk_-7275852970796318644
2013-10-31 18:36:59,119 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data3/current/blk_-2889835826154294416 for deletion
2013-10-31 18:36:59,120 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data3/current/blk_-2889835826154294416
2013-10-31 18:36:59,837 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000004_0 0.0% cleanup
2013-10-31 18:36:59,838 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000004_0 is done.
2013-10-31 18:36:59,839 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000004_0  was -1
2013-10-31 18:36:59,839 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:59,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data6/current/blk_-7715455870848698122 for deletion
2013-10-31 18:36:59,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275852970796318644_1200 file build/test/data/dfs/data/data5/current/blk_-7275852970796318644 for deletion
2013-10-31 18:36:59,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data6/current/blk_-7715455870848698122
2013-10-31 18:36:59,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data5/current/blk_-2889835826154294416 for deletion
2013-10-31 18:36:59,848 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275852970796318644_1200 at file build/test/data/dfs/data/data5/current/blk_-7275852970796318644
2013-10-31 18:36:59,849 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1742899109407851518_1201 file build/test/data/dfs/data/data6/current/blk_-1742899109407851518 for deletion
2013-10-31 18:36:59,849 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data5/current/blk_-2889835826154294416
2013-10-31 18:36:59,849 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1742899109407851518_1201 at file build/test/data/dfs/data/data6/current/blk_-1742899109407851518
2013-10-31 18:37:00,317 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:37:00,319 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 2ms
2013-10-31 18:37:00,780 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:37:00,780 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:37:01,483 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-7275852970796318644_1200 blk_-1742899109407851518_1201
2013-10-31 18:37:01,484 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-1742899109407851518_1201
2013-10-31 18:37:01,787 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000004_0' has completed task_20131031182606197_0020_m_000004 successfully.
2013-10-31 18:37:01,788 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0020 has completed successfully.
2013-10-31 18:37:01,789 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0020,submitTime=1383244589088,launchTime=1383244589820,firstMapTaskLaunchTime=1383244597740,firstReduceTaskLaunchTime=1383244603754,firstJobSetupTaskLaunchTime=1383244591717,firstJobCleanupTaskLaunchTime=1383244615776,finishTime=1383244621788,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=11,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[48399E9CDDC34DFD9CFA0870313E769E/62D39B72A191451881E805B7E8332542] test/(1/1) ...fieldedpipesplatform/swap
2013-10-31 18:37:01,795 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518. blk_-8810471189237826350_1206
2013-10-31 18:37:01,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8810471189237826350_1206 src: /127.0.0.1:50538 dest: /127.0.0.1:34578
2013-10-31 18:37:01,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8810471189237826350_1206 src: /127.0.0.1:43736 dest: /127.0.0.1:59471
2013-10-31 18:37:01,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8810471189237826350_1206 src: /127.0.0.1:47628 dest: /127.0.0.1:37740
2013-10-31 18:37:01,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47628, dest: /127.0.0.1:37740, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8810471189237826350_1206, duration: 2709867
2013-10-31 18:37:01,811 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8810471189237826350_1206 terminating
2013-10-31 18:37:01,812 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43736, dest: /127.0.0.1:59471, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8810471189237826350_1206, duration: 3590104
2013-10-31 18:37:01,813 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8810471189237826350_1206 terminating
2013-10-31 18:37:01,813 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50538, dest: /127.0.0.1:34578, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8810471189237826350_1206, duration: 4776419
2013-10-31 18:37:01,814 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8810471189237826350_1206 terminating
2013-10-31 18:37:01,817 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8810471189237826350_1206 size 28302
2013-10-31 18:37:01,817 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 from client DFSClient_-791702297
2013-10-31 18:37:01,818 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 is closed by DFSClient_-791702297
2013-10-31 18:37:01,818 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8810471189237826350_1206 size 28302
2013-10-31 18:37:01,818 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8810471189237826350_1206 size 28302
2013-10-31 18:37:01,824 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:01,824 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000000_0'
2013-10-31 18:37:01,825 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000004_0'
2013-10-31 18:37:01,825 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000005_0'
2013-10-31 18:37:01,825 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_r_000000_0'
2013-10-31 18:37:01,827 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2967099774717268511 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:01,827 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2967099774717268511 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:01,827 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000002_0'
2013-10-31 18:37:01,827 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2967099774717268511 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:01,830 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0020_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:01,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020	dst=null	perm=null
2013-10-31 18:37:01,835 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary
2013-10-31 18:37:01,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap	dst=null	perm=null
2013-10-31 18:37:01,855 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1793)) - Reconciled asynchronous block scan with filesystem. 0 blocks concurrently deleted during scan, 1 blocks concurrently added during scan, 0 ongoing creations ignored
2013-10-31 18:37:01,855 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:01,855 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:37:01,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000	dst=null	perm=null
2013-10-31 18:37:01,863 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:37740, blocks: 50, processing time: 6 msecs
2013-10-31 18:37:01,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000	dst=null	perm=null
2013-10-31 18:37:01,863 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 50 blocks took 1 msec to generate and 7 msecs for RPC and NN processing
2013-10-31 18:37:01,866 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47913, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-713045408687538439_1205, duration: 292720
2013-10-31 18:37:01,866 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/swap
2013-10-31 18:37:01,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap	dst=null	perm=null
2013-10-31 18:37:01,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000	dst=null	perm=null
2013-10-31 18:37:01,875 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50543, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-713045408687538439_1205, duration: 348409
2013-10-31 18:37:01,877 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000003_0'
2013-10-31 18:37:01,897 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:37:01,898 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:37:01,912 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:37:01,912 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:37:01,913 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter"]
2013-10-31 18:37:01,913 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:37:01,913 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:37:01,913 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:37:01,914 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pipesplatform/logicfilter
2013-10-31 18:37:01,917 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:37:01,917 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:37:01,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:01,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:37:01,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:01,939 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar. blk_6825170116649135168_1207
2013-10-31 18:37:01,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:47915 dest: /127.0.0.1:54365
2013-10-31 18:37:01,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:47633 dest: /127.0.0.1:37740
2013-10-31 18:37:01,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:43743 dest: /127.0.0.1:59471
2013-10-31 18:37:01,951 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43743, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6825170116649135168_1207, duration: 3863769
2013-10-31 18:37:01,952 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6825170116649135168_1207 terminating
2013-10-31 18:37:01,952 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47633, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6825170116649135168_1207, duration: 4729601
2013-10-31 18:37:01,952 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6825170116649135168_1207 terminating
2013-10-31 18:37:01,953 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47915, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6825170116649135168_1207, duration: 5633437
2013-10-31 18:37:01,953 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6825170116649135168_1207 terminating
2013-10-31 18:37:01,955 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:01,955 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar from client DFSClient_-1596270109
2013-10-31 18:37:01,956 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:37:01,956 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:01,957 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:01,961 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar. New replication is 10
2013-10-31 18:37:01,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=null
2013-10-31 18:37:01,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:01,970 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:37:01,974 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:01,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:02,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,245 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split. New replication is 10
2013-10-31 18:37:02,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=null
2013-10-31 18:37:02,254 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split. blk_-6356891254658155288_1208
2013-10-31 18:37:02,256 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:43744 dest: /127.0.0.1:59471
2013-10-31 18:37:02,257 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:47919 dest: /127.0.0.1:54365
2013-10-31 18:37:02,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:50549 dest: /127.0.0.1:34578
2013-10-31 18:37:02,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:47638 dest: /127.0.0.1:37740
2013-10-31 18:37:02,264 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47638, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6356891254658155288_1208, duration: 120323
2013-10-31 18:37:02,264 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50549, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6356891254658155288_1208, duration: 942963
2013-10-31 18:37:02,265 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47919, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6356891254658155288_1208, duration: 1849947
2013-10-31 18:37:02,266 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,266 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,266 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43744, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6356891254658155288_1208, duration: 2660244
2013-10-31 18:37:02,267 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,267 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,270 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split from client DFSClient_-1596270109
2013-10-31 18:37:02,270 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split is closed by DFSClient_-1596270109
2013-10-31 18:37:02,271 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,288 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo. blk_-4498923493520451421_1209
2013-10-31 18:37:02,289 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4498923493520451421_1209 src: /127.0.0.1:47639 dest: /127.0.0.1:37740
2013-10-31 18:37:02,291 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4498923493520451421_1209 src: /127.0.0.1:47923 dest: /127.0.0.1:54365
2013-10-31 18:37:02,293 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4498923493520451421_1209 src: /127.0.0.1:50553 dest: /127.0.0.1:34578
2013-10-31 18:37:02,296 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50553, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4498923493520451421_1209, duration: 70407
2013-10-31 18:37:02,296 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4498923493520451421_1209 terminating
2013-10-31 18:37:02,296 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47923, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4498923493520451421_1209, duration: 887546
2013-10-31 18:37:02,297 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4498923493520451421_1209 terminating
2013-10-31 18:37:02,297 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47639, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4498923493520451421_1209, duration: 1677436
2013-10-31 18:37:02,298 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4498923493520451421_1209 terminating
2013-10-31 18:37:02,301 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4498923493520451421_1209 size 156
2013-10-31 18:37:02,302 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:37:02,302 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:37:02,302 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4498923493520451421_1209 size 156
2013-10-31 18:37:02,303 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4498923493520451421_1209 size 156
2013-10-31 18:37:02,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,323 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml. blk_5776063125288327320_1210
2013-10-31 18:37:02,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5776063125288327320_1210 src: /127.0.0.1:47925 dest: /127.0.0.1:54365
2013-10-31 18:37:02,325 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5776063125288327320_1210 src: /127.0.0.1:43752 dest: /127.0.0.1:59471
2013-10-31 18:37:02,326 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5776063125288327320_1210 src: /127.0.0.1:50556 dest: /127.0.0.1:34578
2013-10-31 18:37:02,328 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50556, dest: /127.0.0.1:34578, bytes: 27480, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5776063125288327320_1210, duration: 791145
2013-10-31 18:37:02,328 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5776063125288327320_1210 terminating
2013-10-31 18:37:02,328 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43752, dest: /127.0.0.1:59471, bytes: 27480, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5776063125288327320_1210, duration: 644962
2013-10-31 18:37:02,328 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5776063125288327320_1210 size 27480
2013-10-31 18:37:02,329 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47925, dest: /127.0.0.1:54365, bytes: 27480, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 1477387
2013-10-31 18:37:02,328 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5776063125288327320_1210 terminating
2013-10-31 18:37:02,329 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5776063125288327320_1210 terminating
2013-10-31 18:37:02,330 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5776063125288327320_1210 size 27480
2013-10-31 18:37:02,331 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml from client DFSClient_-1596270109
2013-10-31 18:37:02,331 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:37:02,332 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5776063125288327320_1210 size 27480
2013-10-31 18:37:02,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=null
2013-10-31 18:37:02,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50558, bytes: 27696, op: HDFS_READ, cliID: DFSClient_1340806675, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5776063125288327320_1210, duration: 189164
2013-10-31 18:37:02,356 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0021: nMaps=4 nReduces=0 max=-1
2013-10-31 18:37:02,356 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0021 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:37:02,356 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0021	RESULT=SUCCESS
2013-10-31 18:37:02,357 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0021
2013-10-31 18:37:02,357 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0021
2013-10-31 18:37:02,357 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0021
2013-10-31 18:37:02,359 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 78 raw values into 1 aggregated values, total 6
2013-10-31 18:37:02,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,375 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml. blk_-7503252741964220374_1212
2013-10-31 18:37:02,378 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7503252741964220374_1212 src: /127.0.0.1:50559 dest: /127.0.0.1:34578
2013-10-31 18:37:02,378 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7503252741964220374_1212 src: /127.0.0.1:47648 dest: /127.0.0.1:37740
2013-10-31 18:37:02,379 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7503252741964220374_1212 src: /127.0.0.1:47932 dest: /127.0.0.1:54365
2013-10-31 18:37:02,381 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47932, dest: /127.0.0.1:54365, bytes: 27545, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7503252741964220374_1212, duration: 101245
2013-10-31 18:37:02,381 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7503252741964220374_1212 terminating
2013-10-31 18:37:02,381 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47648, dest: /127.0.0.1:37740, bytes: 27545, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7503252741964220374_1212, duration: 474462
2013-10-31 18:37:02,381 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7503252741964220374_1212 terminating
2013-10-31 18:37:02,382 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50559, dest: /127.0.0.1:34578, bytes: 27545, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7503252741964220374_1212, duration: 1009870
2013-10-31 18:37:02,382 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7503252741964220374_1212 terminating
2013-10-31 18:37:02,384 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7503252741964220374_1212 size 27545
2013-10-31 18:37:02,384 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml from client DFSClient_1340806675
2013-10-31 18:37:02,385 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml is closed by DFSClient_1340806675
2013-10-31 18:37:02,385 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7503252741964220374_1212 size 27545
2013-10-31 18:37:02,386 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7503252741964220374_1212 size 27545
2013-10-31 18:37:02,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,396 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken. blk_-3539146678558007319_1213
2013-10-31 18:37:02,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3539146678558007319_1213 src: /127.0.0.1:47650 dest: /127.0.0.1:37740
2013-10-31 18:37:02,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3539146678558007319_1213 src: /127.0.0.1:43760 dest: /127.0.0.1:59471
2013-10-31 18:37:02,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3539146678558007319_1213 src: /127.0.0.1:47935 dest: /127.0.0.1:54365
2013-10-31 18:37:02,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47935, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3539146678558007319_1213, duration: 804346
2013-10-31 18:37:02,401 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3539146678558007319_1213 terminating
2013-10-31 18:37:02,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43760, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 450050
2013-10-31 18:37:02,402 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3539146678558007319_1213 terminating
2013-10-31 18:37:02,403 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47650, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3539146678558007319_1213, duration: 1572516
2013-10-31 18:37:02,403 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3539146678558007319_1213 terminating
2013-10-31 18:37:02,404 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3539146678558007319_1213 size 116
2013-10-31 18:37:02,405 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken from client DFSClient_-1596270109
2013-10-31 18:37:02,405 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:37:02,405 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3539146678558007319_1213 size 116
2013-10-31 18:37:02,406 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3539146678558007319_1213 size 116
2013-10-31 18:37:02,410 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken
2013-10-31 18:37:02,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:37:02,414 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47653, bytes: 160, op: HDFS_READ, cliID: DFSClient_1340806675, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4498923493520451421_1209, duration: 124532
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0021 = 1449. Number of splits = 4
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0021 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:37:02,416 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0021 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:37:03,246 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data2/current/blk_-7715455870848698122 for deletion
2013-10-31 18:37:03,246 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275852970796318644_1200 file build/test/data/dfs/data/data1/current/blk_-7275852970796318644 for deletion
2013-10-31 18:37:03,246 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data2/current/blk_-7715455870848698122
2013-10-31 18:37:03,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275852970796318644_1200 at file build/test/data/dfs/data/data1/current/blk_-7275852970796318644
2013-10-31 18:37:03,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data1/current/blk_-2889835826154294416 for deletion
2013-10-31 18:37:03,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1742899109407851518_1201 file build/test/data/dfs/data/data2/current/blk_-1742899109407851518 for deletion
2013-10-31 18:37:03,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data1/current/blk_-2889835826154294416
2013-10-31 18:37:03,248 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1742899109407851518_1201 at file build/test/data/dfs/data/data2/current/blk_-1742899109407851518
2013-10-31 18:37:03,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data7/current/blk_-7715455870848698122 for deletion
2013-10-31 18:37:03,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data7/current/blk_-2889835826154294416 for deletion
2013-10-31 18:37:03,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data7/current/blk_-7715455870848698122
2013-10-31 18:37:03,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1742899109407851518_1201 file build/test/data/dfs/data/data8/current/blk_-1742899109407851518 for deletion
2013-10-31 18:37:03,320 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data7/current/blk_-2889835826154294416
2013-10-31 18:37:03,320 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1742899109407851518_1201 at file build/test/data/dfs/data/data8/current/blk_-1742899109407851518
2013-10-31 18:37:04,485 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_6825170116649135168_1207 to datanode(s) 127.0.0.1:34578
2013-10-31 18:37:04,485 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_2967099774717268511_1204
2013-10-31 18:37:04,485 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_2967099774717268511_1204
2013-10-31 18:37:04,791 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0021_m_000005_0' to tip task_20131031182606197_0021_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:04,797 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000001_0'
2013-10-31 18:37:04,799 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:37:04,799 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000005_0 which needs 1 slots
2013-10-31 18:37:04,799 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000005_0 which needs 1 slots
2013-10-31 18:37:04,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken	dst=null	perm=null
2013-10-31 18:37:04,808 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43763, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 303610
2013-10-31 18:37:04,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=null
2013-10-31 18:37:04,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47939, bytes: 27696, op: HDFS_READ, cliID: DFSClient_1546836711, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 397974
2013-10-31 18:37:04,850 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:04,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=null
2013-10-31 18:37:04,873 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43766, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1546836711, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6825170116649135168_1207, duration: 890813
2013-10-31 18:37:04,931 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-536120217
2013-10-31 18:37:04,932 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-536120217 spawned.
2013-10-31 18:37:04,933 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000005_0/taskjvm.sh
2013-10-31 18:37:06,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2967099774717268511_1204 file build/test/data/dfs/data/data2/current/blk_2967099774717268511 for deletion
2013-10-31 18:37:06,247 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2967099774717268511_1204 at file build/test/data/dfs/data/data2/current/blk_2967099774717268511
2013-10-31 18:37:06,278 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-536120217 given task: attempt_20131031182606197_0021_m_000005_0
2013-10-31 18:37:06,319 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_6825170116649135168_1207 to 127.0.0.1:34578 
2013-10-31 18:37:06,320 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2967099774717268511_1204 file build/test/data/dfs/data/data8/current/blk_2967099774717268511 for deletion
2013-10-31 18:37:06,320 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2967099774717268511_1204 at file build/test/data/dfs/data/data8/current/blk_2967099774717268511
2013-10-31 18:37:06,321 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:50571 dest: /127.0.0.1:34578
2013-10-31 18:37:06,321 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_6825170116649135168_1207 to /127.0.0.1:34578
2013-10-31 18:37:06,322 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6825170116649135168_1207 src: /127.0.0.1:50571 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:37:06,323 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:06,827 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:06,828 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0020_m_000004_0 not found in cache
2013-10-31 18:37:06,828 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331026828
2013-10-31 18:37:06,867 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:06,868 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331026868
2013-10-31 18:37:06,878 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:06,879 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331026879
2013-10-31 18:37:06,944 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_394041626 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:06,955 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27856 with signal TERM. Exit code 0
2013-10-31 18:37:07,165 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:07,165 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:07,165 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:07,166 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_394041626 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:07,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:07,441 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_r_606975538 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:07,451 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28103 with signal TERM. Exit code 0
2013-10-31 18:37:07,486 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_2967099774717268511_1204
2013-10-31 18:37:07,632 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:07,632 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:07,632 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:07,632 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_r_606975538 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:07,877 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-1374561285 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:07,887 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27652 with signal TERM. Exit code 0
2013-10-31 18:37:08,099 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:08,100 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:08,100 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:08,100 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-1374561285 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:37:08,160 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-614092363 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:08,165 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-1210448733 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:08,171 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27906 with signal TERM. Exit code 0
2013-10-31 18:37:08,184 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27905 with signal TERM. Exit code 0
2013-10-31 18:37:08,387 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:08,387 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:08,387 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:08,387 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-1210448733 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:08,399 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:08,399 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:08,399 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:08,399 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-614092363 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:08,851 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2967099774717268511_1204 file build/test/data/dfs/data/data5/current/blk_2967099774717268511 for deletion
2013-10-31 18:37:08,851 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2967099774717268511_1204 at file build/test/data/dfs/data/data5/current/blk_2967099774717268511
2013-10-31 18:37:09,718 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000005_0 0.0% setup
2013-10-31 18:37:09,721 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000005_0 is done.
2013-10-31 18:37:09,722 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000005_0  was -1
2013-10-31 18:37:09,722 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:09,799 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:09,800 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331029800
2013-10-31 18:37:10,805 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000005_0' has completed task_20131031182606197_0021_m_000005 successfully.
2013-10-31 18:37:10,809 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000000_0' to tip task_20131031182606197_0021_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:10,810 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000000
2013-10-31 18:37:10,812 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:37:10,812 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000000_0 which needs 1 slots
2013-10-31 18:37:10,812 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000000_0 which needs 1 slots
2013-10-31 18:37:10,838 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000001_0' to tip task_20131031182606197_0021_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:10,839 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000001
2013-10-31 18:37:10,840 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:37:10,841 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000001_0 which needs 1 slots
2013-10-31 18:37:10,841 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000001_0 which needs 1 slots
2013-10-31 18:37:10,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken	dst=null	perm=null
2013-10-31 18:37:10,848 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0021/attempt_20131031182606197_0021_m_000000_0. Attempting to reuse: jvm_20131031182606197_0021_m_-536120217
2013-10-31 18:37:10,849 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43770, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 281323
2013-10-31 18:37:10,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=null
2013-10-31 18:37:10,857 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43772, bytes: 27696, op: HDFS_READ, cliID: DFSClient_-610174536, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5776063125288327320_1210, duration: 184847
2013-10-31 18:37:10,876 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000002_0' to tip task_20131031182606197_0021_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:37:10,877 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000002
2013-10-31 18:37:10,879 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:37:10,879 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000002_0 which needs 1 slots
2013-10-31 18:37:10,880 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000002_0 which needs 1 slots
2013-10-31 18:37:10,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken	dst=null	perm=null
2013-10-31 18:37:10,886 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000003_0' to tip task_20131031182606197_0021_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:37:10,887 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000003
2013-10-31 18:37:10,887 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:10,888 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:37:10,889 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000003_0 which needs 1 slots
2013-10-31 18:37:10,889 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43773, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 263093
2013-10-31 18:37:10,889 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000003_0 which needs 1 slots
2013-10-31 18:37:10,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken	dst=null	perm=null
2013-10-31 18:37:10,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=null
2013-10-31 18:37:10,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47666, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3539146678558007319_1213, duration: 263293
2013-10-31 18:37:10,900 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47950, bytes: 27696, op: HDFS_READ, cliID: DFSClient_409215913, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 395761
2013-10-31 18:37:10,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml	dst=null	perm=null
2013-10-31 18:37:10,908 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47952, bytes: 27696, op: HDFS_READ, cliID: DFSClient_-751574938, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 389891
2013-10-31 18:37:10,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=null
2013-10-31 18:37:10,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43779, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-610174536, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6825170116649135168_1207, duration: 1568564
2013-10-31 18:37:10,920 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:10,921 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:10,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=null
2013-10-31 18:37:10,937 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47954, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-751574938, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6825170116649135168_1207, duration: 644130
2013-10-31 18:37:10,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar	dst=null	perm=null
2013-10-31 18:37:10,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47672, bytes: 239915, op: HDFS_READ, cliID: DFSClient_409215913, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6825170116649135168_1207, duration: 618863
2013-10-31 18:37:10,992 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-1495739159
2013-10-31 18:37:10,992 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-1495739159 spawned.
2013-10-31 18:37:10,995 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000001_0/taskjvm.sh
2013-10-31 18:37:10,999 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-1540473190
2013-10-31 18:37:11,000 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-1540473190 spawned.
2013-10-31 18:37:11,001 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000003_0/taskjvm.sh
2013-10-31 18:37:11,004 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-1217830969
2013-10-31 18:37:11,004 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-1217830969 spawned.
2013-10-31 18:37:11,005 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000002_0/taskjvm.sh
2013-10-31 18:37:11,163 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-873425933 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:11,173 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27907 with signal TERM. Exit code 0
2013-10-31 18:37:11,270 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-536120217 given task: attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:11,404 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:11,404 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:11,404 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:11,404 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-873425933 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:11,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=null
2013-10-31 18:37:11,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43783, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6356891254658155288_1208, duration: 174221
2013-10-31 18:37:11,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:11,859 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50587, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 131597
2013-10-31 18:37:11,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:11,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:12,072 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000. blk_-2773960523731250447_1214
2013-10-31 18:37:12,096 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2773960523731250447_1214 src: /127.0.0.1:50588 dest: /127.0.0.1:34578
2013-10-31 18:37:12,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2773960523731250447_1214 src: /127.0.0.1:47960 dest: /127.0.0.1:54365
2013-10-31 18:37:12,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2773960523731250447_1214 src: /127.0.0.1:47678 dest: /127.0.0.1:37740
2013-10-31 18:37:12,100 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47678, dest: /127.0.0.1:37740, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2773960523731250447_1214, duration: 1622769
2013-10-31 18:37:12,101 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2773960523731250447_1214 terminating
2013-10-31 18:37:12,101 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47960, dest: /127.0.0.1:54365, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2773960523731250447_1214, duration: 2042619
2013-10-31 18:37:12,101 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2773960523731250447_1214 terminating
2013-10-31 18:37:12,101 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50588, dest: /127.0.0.1:34578, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2773960523731250447_1214, duration: 2486929
2013-10-31 18:37:12,102 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2773960523731250447_1214 terminating
2013-10-31 18:37:12,102 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2773960523731250447_1214 size 181
2013-10-31 18:37:12,102 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2773960523731250447_1214 size 181
2013-10-31 18:37:12,103 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2773960523731250447_1214 size 181
2013-10-31 18:37:12,103 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:12,103 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:12,140 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:12,141 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000000_0 0.0% 
2013-10-31 18:37:12,548 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-1540473190 given task: attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:12,554 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-1217830969 given task: attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:12,558 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-1495739159 given task: attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=null
2013-10-31 18:37:13,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50597, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6356891254658155288_1208, duration: 129407
2013-10-31 18:37:13,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=null
2013-10-31 18:37:13,053 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50598, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6356891254658155288_1208, duration: 143377
2013-10-31 18:37:13,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split	dst=null	perm=null
2013-10-31 18:37:13,063 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47687, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6356891254658155288_1208, duration: 142953
2013-10-31 18:37:13,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:13,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50600, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 143084
2013-10-31 18:37:13,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:13,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:13,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:13,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:13,102 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47972, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 163408
2013-10-31 18:37:13,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:13,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:13,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:13,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:13,268 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003. blk_-4087558079339850927_1217
2013-10-31 18:37:13,270 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50602, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 192067
2013-10-31 18:37:13,274 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001. blk_2038428419949332083_1217
2013-10-31 18:37:13,286 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:13,286 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:13,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4087558079339850927_1217 src: /127.0.0.1:47691 dest: /127.0.0.1:37740
2013-10-31 18:37:13,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4087558079339850927_1217 src: /127.0.0.1:43802 dest: /127.0.0.1:59471
2013-10-31 18:37:13,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4087558079339850927_1217 src: /127.0.0.1:47977 dest: /127.0.0.1:54365
2013-10-31 18:37:13,303 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47977, dest: /127.0.0.1:54365, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4087558079339850927_1217, duration: 1380604
2013-10-31 18:37:13,303 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4087558079339850927_1217 terminating
2013-10-31 18:37:13,304 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43802, dest: /127.0.0.1:59471, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4087558079339850927_1217, duration: 1711572
2013-10-31 18:37:13,304 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4087558079339850927_1217 terminating
2013-10-31 18:37:13,304 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47691, dest: /127.0.0.1:37740, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4087558079339850927_1217, duration: 2074382
2013-10-31 18:37:13,304 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4087558079339850927_1217 terminating
2013-10-31 18:37:13,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2038428419949332083_1217 src: /127.0.0.1:47692 dest: /127.0.0.1:37740
2013-10-31 18:37:13,306 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4087558079339850927_1217 size 180
2013-10-31 18:37:13,307 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2038428419949332083_1217 src: /127.0.0.1:43804 dest: /127.0.0.1:59471
2013-10-31 18:37:13,308 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4087558079339850927_1217 size 180
2013-10-31 18:37:13,308 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2038428419949332083_1217 src: /127.0.0.1:50608 dest: /127.0.0.1:34578
2013-10-31 18:37:13,308 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4087558079339850927_1217 size 180
2013-10-31 18:37:13,310 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50608, dest: /127.0.0.1:34578, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2038428419949332083_1217, duration: 1681276
2013-10-31 18:37:13,311 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2038428419949332083_1217 terminating
2013-10-31 18:37:13,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43804, dest: /127.0.0.1:59471, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2038428419949332083_1217, duration: 2103702
2013-10-31 18:37:13,311 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2038428419949332083_1217 terminating
2013-10-31 18:37:13,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47692, dest: /127.0.0.1:37740, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2038428419949332083_1217, duration: 2460134
2013-10-31 18:37:13,311 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2038428419949332083_1217 terminating
2013-10-31 18:37:13,312 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2038428419949332083_1217 size 134
2013-10-31 18:37:13,312 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,312 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,312 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2038428419949332083_1217 size 134
2013-10-31 18:37:13,314 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2038428419949332083_1217 size 134
2013-10-31 18:37:13,332 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:13,333 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000002_0 0.0% 
2013-10-31 18:37:13,361 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:13,361 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000001_0 0.0% 
2013-10-31 18:37:13,706 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:13,707 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:13,771 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:13,771 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000003_0 0.0% 
2013-10-31 18:37:13,816 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:13,844 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,883 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:13,892 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:14,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0	dst=null	perm=null
2013-10-31 18:37:14,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:14,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:14,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0	dst=null	perm=null
2013-10-31 18:37:14,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0	dst=null	perm=null
2013-10-31 18:37:14,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:14,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0	dst=null	perm=null
2013-10-31 18:37:14,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:14,775 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:37:14,777 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000000_0 is done.
2013-10-31 18:37:14,777 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000000_0  was -1
2013-10-31 18:37:14,778 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:15,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0	dst=null	perm=null
2013-10-31 18:37:15,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:15,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:15,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:15,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:15,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0	dst=null	perm=null
2013-10-31 18:37:15,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0	dst=null	perm=null
2013-10-31 18:37:15,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0	dst=null	perm=null
2013-10-31 18:37:15,812 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0021_m_000005_0
2013-10-31 18:37:15,813 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0021_m_000005_0
2013-10-31 18:37:15,813 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000005_0 not found in cache
2013-10-31 18:37:15,974 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:37:15,976 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000003_0 is done.
2013-10-31 18:37:15,976 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000003_0  was -1
2013-10-31 18:37:15,976 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:15,983 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:37:15,984 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000001_0 is done.
2013-10-31 18:37:15,985 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000001_0  was -1
2013-10-31 18:37:15,985 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:15,992 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:37:15,993 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000002_0 is done.
2013-10-31 18:37:15,993 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000002_0  was -1
2013-10-31 18:37:15,994 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:16,820 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000000_0' has completed task_20131031182606197_0021_m_000000 successfully.
2013-10-31 18:37:16,848 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000001_0' has completed task_20131031182606197_0021_m_000001 successfully.
2013-10-31 18:37:16,886 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000002_0' has completed task_20131031182606197_0021_m_000002 successfully.
2013-10-31 18:37:16,895 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000003_0' has completed task_20131031182606197_0021_m_000003 successfully.
2013-10-31 18:37:16,899 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0021_m_000004_0' to tip task_20131031182606197_0021_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:37:16,901 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:37:16,901 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000004_0 which needs 1 slots
2013-10-31 18:37:16,901 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000004_0 which needs 1 slots
2013-10-31 18:37:16,933 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_949917260
2013-10-31 18:37:16,934 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_949917260 spawned.
2013-10-31 18:37:16,936 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000004_0/taskjvm.sh
2013-10-31 18:37:17,769 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_949917260 given task: attempt_20131031182606197_0021_m_000004_0
2013-10-31 18:37:18,262 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000004_0 0.0% 
2013-10-31 18:37:18,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary	dst=null	perm=null
2013-10-31 18:37:18,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:18,283 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_SUCCESS from client DFSClient_attempt_20131031182606197_0021_m_000004_0
2013-10-31 18:37:18,283 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0021_m_000004_0
2013-10-31 18:37:18,289 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,289 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:18,289 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:18,289 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,290 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,290 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:18,290 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:18,290 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,290 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4498923493520451421 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,290 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4498923493520451421 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,291 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4498923493520451421 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:18,291 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5776063125288327320 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,291 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5776063125288327320 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,291 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5776063125288327320 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:18,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021	dst=null	perm=null
2013-10-31 18:37:19,488 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_5776063125288327320_1210 blk_-4498923493520451421_1209 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:19,488 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5776063125288327320_1210 blk_-4498923493520451421_1209 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:20,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data3/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:20,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4498923493520451421_1209 file build/test/data/dfs/data/data4/current/blk_-4498923493520451421 for deletion
2013-10-31 18:37:20,126 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5776063125288327320_1210 file build/test/data/dfs/data/data3/current/blk_5776063125288327320 for deletion
2013-10-31 18:37:20,127 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data4/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:20,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data3/current/blk_-6356891254658155288
2013-10-31 18:37:20,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5776063125288327320_1210 at file build/test/data/dfs/data/data3/current/blk_5776063125288327320
2013-10-31 18:37:20,331 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4498923493520451421_1209 at file build/test/data/dfs/data/data4/current/blk_-4498923493520451421
2013-10-31 18:37:20,331 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data4/current/blk_6825170116649135168
2013-10-31 18:37:21,197 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000004_0 0.0% cleanup
2013-10-31 18:37:21,199 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000004_0 is done.
2013-10-31 18:37:21,199 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000004_0  was -1
2013-10-31 18:37:21,200 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:21,251 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data1/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:21,252 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4498923493520451421_1209 file build/test/data/dfs/data/data2/current/blk_-4498923493520451421 for deletion
2013-10-31 18:37:21,252 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data1/current/blk_-6356891254658155288
2013-10-31 18:37:21,252 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4498923493520451421_1209 at file build/test/data/dfs/data/data2/current/blk_-4498923493520451421
2013-10-31 18:37:21,252 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5776063125288327320_1210 file build/test/data/dfs/data/data1/current/blk_5776063125288327320 for deletion
2013-10-31 18:37:21,253 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5776063125288327320_1210 at file build/test/data/dfs/data/data1/current/blk_5776063125288327320
2013-10-31 18:37:21,253 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data1/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:21,253 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data1/current/blk_6825170116649135168
2013-10-31 18:37:22,489 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-4498923493520451421_1209 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:22,489 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5776063125288327320_1210 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:22,909 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000004_0' has completed task_20131031182606197_0021_m_000004 successfully.
2013-10-31 18:37:22,910 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0021 has completed successfully.
2013-10-31 18:37:22,911 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0021,submitTime=1383244622335,launchTime=1383244622416,firstMapTaskLaunchTime=1383244630808,firstJobSetupTaskLaunchTime=1383244624790,firstJobCleanupTaskLaunchTime=1383244636899,finishTime=1383244642910,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=28,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D9B1645405A54AE19107C776496603BD/7AE21C4F457146A7A8D58E2E27F779D9] test/(1/1) ...pipesplatform/logicfilter
2013-10-31 18:37:22,916 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7. blk_-4297281594000158562_1218
2013-10-31 18:37:22,918 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4297281594000158562_1218 src: /127.0.0.1:50613 dest: /127.0.0.1:34578
2013-10-31 18:37:22,921 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4297281594000158562_1218 src: /127.0.0.1:43811 dest: /127.0.0.1:59471
2013-10-31 18:37:22,922 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4297281594000158562_1218 src: /127.0.0.1:47703 dest: /127.0.0.1:37740
2013-10-31 18:37:22,925 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47703, dest: /127.0.0.1:37740, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4297281594000158562_1218, duration: 193181
2013-10-31 18:37:22,926 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4297281594000158562_1218 terminating
2013-10-31 18:37:22,926 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43811, dest: /127.0.0.1:59471, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4297281594000158562_1218, duration: 1008175
2013-10-31 18:37:22,927 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4297281594000158562_1218 terminating
2013-10-31 18:37:22,927 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50613, dest: /127.0.0.1:34578, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4297281594000158562_1218, duration: 2235112
2013-10-31 18:37:22,928 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4297281594000158562_1218 terminating
2013-10-31 18:37:22,931 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4297281594000158562_1218 size 22363
2013-10-31 18:37:22,933 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4297281594000158562_1218 size 22363
2013-10-31 18:37:22,933 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4297281594000158562_1218 size 22363
2013-10-31 18:37:22,934 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 from client DFSClient_1340806675
2013-10-31 18:37:22,935 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 is closed by DFSClient_1340806675
2013-10-31 18:37:22,942 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:22,943 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000003_0'
2013-10-31 18:37:22,943 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000004_0'
2013-10-31 18:37:22,945 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3539146678558007319 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:22,945 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3539146678558007319 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:22,945 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3539146678558007319 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:22,948 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0021_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:22,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021	dst=null	perm=null
2013-10-31 18:37:22,952 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary
2013-10-31 18:37:22,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter	dst=null	perm=null
2013-10-31 18:37:22,974 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:37:22,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000	dst=null	perm=null
2013-10-31 18:37:22,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001	dst=null	perm=null
2013-10-31 18:37:22,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002	dst=null	perm=null
2013-10-31 18:37:22,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003	dst=null	perm=null
2013-10-31 18:37:22,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000	dst=null	perm=null
2013-10-31 18:37:22,983 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47988, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2773960523731250447_1214, duration: 350219
2013-10-31 18:37:22,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001	dst=null	perm=null
2013-10-31 18:37:22,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43815, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2038428419949332083_1217, duration: 262448
2013-10-31 18:37:22,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002	dst=null	perm=null
2013-10-31 18:37:22,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003	dst=null	perm=null
2013-10-31 18:37:22,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47990, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4087558079339850927_1217, duration: 366764
2013-10-31 18:37:22,991 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/logicfilter
2013-10-31 18:37:22,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter	dst=null	perm=null
2013-10-31 18:37:22,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000	dst=null	perm=null
2013-10-31 18:37:22,999 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47991, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2773960523731250447_1214, duration: 260214
2013-10-31 18:37:23,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001	dst=null	perm=null
2013-10-31 18:37:23,003 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43818, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2038428419949332083_1217, duration: 269115
2013-10-31 18:37:23,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002	dst=null	perm=null
2013-10-31 18:37:23,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003	dst=null	perm=null
2013-10-31 18:37:23,010 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47710, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4087558079339850927_1217, duration: 283084
2013-10-31 18:37:23,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,021 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt. blk_-677913094566701302_1219
2013-10-31 18:37:23,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-677913094566701302_1219 src: /127.0.0.1:47711 dest: /127.0.0.1:37740
2013-10-31 18:37:23,025 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-677913094566701302_1219 src: /127.0.0.1:47995 dest: /127.0.0.1:54365
2013-10-31 18:37:23,026 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-677913094566701302_1219 src: /127.0.0.1:50625 dest: /127.0.0.1:34578
2013-10-31 18:37:23,029 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50625, dest: /127.0.0.1:34578, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 90478
2013-10-31 18:37:23,030 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-677913094566701302_1219 terminating
2013-10-31 18:37:23,030 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47995, dest: /127.0.0.1:54365, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-677913094566701302_1219, duration: 948676
2013-10-31 18:37:23,031 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-677913094566701302_1219 terminating
2013-10-31 18:37:23,031 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-677913094566701302_1219 size 30
2013-10-31 18:37:23,031 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47711, dest: /127.0.0.1:37740, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 1889544
2013-10-31 18:37:23,032 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-677913094566701302_1219 terminating
2013-10-31 18:37:23,035 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-677913094566701302_1219 size 30
2013-10-31 18:37:23,035 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt from client DFSClient_-1596270109
2013-10-31 18:37:23,035 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt is closed by DFSClient_-1596270109
2013-10-31 18:37:23,036 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-677913094566701302_1219 size 30
2013-10-31 18:37:23,061 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:37:23,062 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:37:23,073 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:37:23,073 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt"]
2013-10-31 18:37:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped"]
2013-10-31 18:37:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:37:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:37:23,074 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:37:23,075 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...edpipesplatform/ungrouped
2013-10-31 18:37:23,078 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:37:23,078 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:37:23,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:23,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:37:23,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,099 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar. blk_6835416087934708249_1220
2013-10-31 18:37:23,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:43823 dest: /127.0.0.1:59471
2013-10-31 18:37:23,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:47715 dest: /127.0.0.1:37740
2013-10-31 18:37:23,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:50628 dest: /127.0.0.1:34578
2013-10-31 18:37:23,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50628, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6835416087934708249_1220, duration: 7009306
2013-10-31 18:37:23,115 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6835416087934708249_1220 terminating
2013-10-31 18:37:23,116 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:23,116 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47715, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6835416087934708249_1220, duration: 7729560
2013-10-31 18:37:23,116 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6835416087934708249_1220 terminating
2013-10-31 18:37:23,117 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43823, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6835416087934708249_1220, duration: 8742752
2013-10-31 18:37:23,117 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6835416087934708249_1220 terminating
2013-10-31 18:37:23,119 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar from client DFSClient_-1596270109
2013-10-31 18:37:23,119 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:37:23,119 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:23,120 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:23,124 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar. New replication is 10
2013-10-31 18:37:23,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar	dst=null	perm=null
2013-10-31 18:37:23,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,138 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:37:23,142 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:23,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:37:23,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,733 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split. New replication is 10
2013-10-31 18:37:23,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=null
2013-10-31 18:37:23,739 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split. blk_-7549849351233677898_1221
2013-10-31 18:37:23,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:50629 dest: /127.0.0.1:34578
2013-10-31 18:37:23,743 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:43827 dest: /127.0.0.1:59471
2013-10-31 18:37:23,744 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:48002 dest: /127.0.0.1:54365
2013-10-31 18:37:23,746 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:47720 dest: /127.0.0.1:37740
2013-10-31 18:37:23,749 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47720, dest: /127.0.0.1:37740, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7549849351233677898_1221, duration: 114008
2013-10-31 18:37:23,750 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48002, dest: /127.0.0.1:54365, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7549849351233677898_1221, duration: 934525
2013-10-31 18:37:23,751 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,751 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43827, dest: /127.0.0.1:59471, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7549849351233677898_1221, duration: 1999441
2013-10-31 18:37:23,752 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,752 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,752 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50629, dest: /127.0.0.1:34578, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7549849351233677898_1221, duration: 2815886
2013-10-31 18:37:23,753 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,756 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split from client DFSClient_-1596270109
2013-10-31 18:37:23,756 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split is closed by DFSClient_-1596270109
2013-10-31 18:37:23,757 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,774 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo. blk_-7735072202814239768_1222
2013-10-31 18:37:23,775 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7735072202814239768_1222 src: /127.0.0.1:50633 dest: /127.0.0.1:34578
2013-10-31 18:37:23,777 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7735072202814239768_1222 src: /127.0.0.1:48005 dest: /127.0.0.1:54365
2013-10-31 18:37:23,779 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7735072202814239768_1222 src: /127.0.0.1:47723 dest: /127.0.0.1:37740
2013-10-31 18:37:23,782 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47723, dest: /127.0.0.1:37740, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7735072202814239768_1222, duration: 628409
2013-10-31 18:37:23,782 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7735072202814239768_1222 terminating
2013-10-31 18:37:23,782 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7735072202814239768_1222 size 183
2013-10-31 18:37:23,782 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48005, dest: /127.0.0.1:54365, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7735072202814239768_1222, duration: 800390
2013-10-31 18:37:23,783 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7735072202814239768_1222 terminating
2013-10-31 18:37:23,783 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50633, dest: /127.0.0.1:34578, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7735072202814239768_1222, duration: 1798117
2013-10-31 18:37:23,784 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7735072202814239768_1222 size 183
2013-10-31 18:37:23,784 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7735072202814239768_1222 terminating
2013-10-31 18:37:23,788 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:37:23,788 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:37:23,788 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7735072202814239768_1222 size 183
2013-10-31 18:37:23,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,812 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml. blk_20087189836750365_1223
2013-10-31 18:37:23,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_20087189836750365_1223 src: /127.0.0.1:50636 dest: /127.0.0.1:34578
2013-10-31 18:37:23,816 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_20087189836750365_1223 src: /127.0.0.1:43834 dest: /127.0.0.1:59471
2013-10-31 18:37:23,817 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_20087189836750365_1223 src: /127.0.0.1:48009 dest: /127.0.0.1:54365
2013-10-31 18:37:23,820 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48009, dest: /127.0.0.1:54365, bytes: 27496, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_20087189836750365_1223, duration: 355482
2013-10-31 18:37:23,820 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_20087189836750365_1223 terminating
2013-10-31 18:37:23,821 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43834, dest: /127.0.0.1:59471, bytes: 27496, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 1114039
2013-10-31 18:37:23,821 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_20087189836750365_1223 terminating
2013-10-31 18:37:23,822 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50636, dest: /127.0.0.1:34578, bytes: 27496, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_20087189836750365_1223, duration: 2025640
2013-10-31 18:37:23,822 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_20087189836750365_1223 terminating
2013-10-31 18:37:23,824 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_20087189836750365_1223 size 27496
2013-10-31 18:37:23,824 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml from client DFSClient_-1596270109
2013-10-31 18:37:23,825 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:37:23,825 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_20087189836750365_1223 size 27496
2013-10-31 18:37:23,825 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_20087189836750365_1223 size 27496
2013-10-31 18:37:23,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml	dst=null	perm=null
2013-10-31 18:37:23,833 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43837, bytes: 27712, op: HDFS_READ, cliID: DFSClient_874298567, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 412687
2013-10-31 18:37:23,841 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0022: nMaps=5 nReduces=0 max=-1
2013-10-31 18:37:23,841 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0022 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:37:23,841 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0022	RESULT=SUCCESS
2013-10-31 18:37:23,841 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0022
2013-10-31 18:37:23,842 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0022
2013-10-31 18:37:23,842 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0022
2013-10-31 18:37:23,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,855 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data5/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:23,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5776063125288327320_1210 file build/test/data/dfs/data/data6/current/blk_5776063125288327320 for deletion
2013-10-31 18:37:23,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data5/current/blk_-6356891254658155288
2013-10-31 18:37:23,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5776063125288327320_1210 at file build/test/data/dfs/data/data6/current/blk_5776063125288327320
2013-10-31 18:37:23,856 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data6/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:23,857 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data6/current/blk_6825170116649135168
2013-10-31 18:37:23,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,869 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml. blk_-6454450828301364300_1225
2013-10-31 18:37:23,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6454450828301364300_1225 src: /127.0.0.1:50641 dest: /127.0.0.1:34578
2013-10-31 18:37:23,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6454450828301364300_1225 src: /127.0.0.1:48013 dest: /127.0.0.1:54365
2013-10-31 18:37:23,874 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6454450828301364300_1225 src: /127.0.0.1:47731 dest: /127.0.0.1:37740
2013-10-31 18:37:23,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47731, dest: /127.0.0.1:37740, bytes: 27561, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6454450828301364300_1225, duration: 614976
2013-10-31 18:37:23,879 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6454450828301364300_1225 terminating
2013-10-31 18:37:23,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48013, dest: /127.0.0.1:54365, bytes: 27561, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6454450828301364300_1225, duration: 2210804
2013-10-31 18:37:23,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6454450828301364300_1225 size 27561
2013-10-31 18:37:23,880 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6454450828301364300_1225 terminating
2013-10-31 18:37:23,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50641, dest: /127.0.0.1:34578, bytes: 27561, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6454450828301364300_1225, duration: 2519936
2013-10-31 18:37:23,881 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6454450828301364300_1225 terminating
2013-10-31 18:37:23,884 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml from client DFSClient_874298567
2013-10-31 18:37:23,884 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml is closed by DFSClient_874298567
2013-10-31 18:37:23,884 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6454450828301364300_1225 size 27561
2013-10-31 18:37:23,885 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6454450828301364300_1225 size 27561
2013-10-31 18:37:23,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,897 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken. blk_8993012588869726418_1226
2013-10-31 18:37:23,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8993012588869726418_1226 src: /127.0.0.1:47732 dest: /127.0.0.1:37740
2013-10-31 18:37:23,901 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8993012588869726418_1226 src: /127.0.0.1:50645 dest: /127.0.0.1:34578
2013-10-31 18:37:23,902 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8993012588869726418_1226 src: /127.0.0.1:48017 dest: /127.0.0.1:54365
2013-10-31 18:37:23,905 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48017, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8993012588869726418_1226, duration: 92121
2013-10-31 18:37:23,905 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8993012588869726418_1226 terminating
2013-10-31 18:37:23,906 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50645, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8993012588869726418_1226, duration: 930164
2013-10-31 18:37:23,906 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8993012588869726418_1226 terminating
2013-10-31 18:37:23,907 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8993012588869726418_1226 size 116
2013-10-31 18:37:23,907 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47732, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8993012588869726418_1226, duration: 1736980
2013-10-31 18:37:23,907 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8993012588869726418_1226 size 116
2013-10-31 18:37:23,907 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8993012588869726418_1226 terminating
2013-10-31 18:37:23,909 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8993012588869726418_1226 size 116
2013-10-31 18:37:23,910 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken from client DFSClient_-1596270109
2013-10-31 18:37:23,911 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:37:23,916 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken
2013-10-31 18:37:23,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:37:23,920 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48018, bytes: 187, op: HDFS_READ, cliID: DFSClient_874298567, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7735072202814239768_1222, duration: 279329
2013-10-31 18:37:23,921 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0022 = 30. Number of splits = 5
2013-10-31 18:37:23,921 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,925 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,925 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,925 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0022 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:37:23,926 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0022 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 18:37:24,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data8/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:24,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4498923493520451421_1209 file build/test/data/dfs/data/data7/current/blk_-4498923493520451421 for deletion
2013-10-31 18:37:24,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data8/current/blk_-6356891254658155288
2013-10-31 18:37:24,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4498923493520451421_1209 at file build/test/data/dfs/data/data7/current/blk_-4498923493520451421
2013-10-31 18:37:24,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data7/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:24,327 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data7/current/blk_6825170116649135168
2013-10-31 18:37:25,490 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_6835416087934708249_1220 to datanode(s) 127.0.0.1:54365
2013-10-31 18:37:25,490 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-3539146678558007319_1213
2013-10-31 18:37:25,491 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-3539146678558007319_1213
2013-10-31 18:37:25,835 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0022_m_000006_0' to tip task_20131031182606197_0022_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:25,840 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000000_0'
2013-10-31 18:37:25,841 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000005_0'
2013-10-31 18:37:25,842 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:37:25,842 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000006_0 which needs 1 slots
2013-10-31 18:37:25,843 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000006_0 which needs 1 slots
2013-10-31 18:37:25,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken	dst=null	perm=null
2013-10-31 18:37:25,851 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47737, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8993012588869726418_1226, duration: 351575
2013-10-31 18:37:25,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml	dst=null	perm=null
2013-10-31 18:37:25,861 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000001_0'
2013-10-31 18:37:25,863 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43848, bytes: 27712, op: HDFS_READ, cliID: DFSClient_1200487348, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 437112
2013-10-31 18:37:25,903 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000002_0'
2013-10-31 18:37:25,908 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:25,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar	dst=null	perm=null
2013-10-31 18:37:25,936 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43849, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1200487348, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6835416087934708249_1220, duration: 1181251
2013-10-31 18:37:26,043 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_412155634
2013-10-31 18:37:26,044 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_412155634 spawned.
2013-10-31 18:37:26,046 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000006_0/taskjvm.sh
2013-10-31 18:37:26,128 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3539146678558007319_1213 file build/test/data/dfs/data/data3/current/blk_-3539146678558007319 for deletion
2013-10-31 18:37:26,128 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3539146678558007319_1213 at file build/test/data/dfs/data/data3/current/blk_-3539146678558007319
2013-10-31 18:37:26,857 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3539146678558007319_1213 file build/test/data/dfs/data/data5/current/blk_-3539146678558007319 for deletion
2013-10-31 18:37:26,857 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3539146678558007319_1213 at file build/test/data/dfs/data/data5/current/blk_-3539146678558007319
2013-10-31 18:37:27,253 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_6835416087934708249_1220 to 127.0.0.1:54365 
2013-10-31 18:37:27,256 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:48024 dest: /127.0.0.1:54365
2013-10-31 18:37:27,256 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_6835416087934708249_1220 to /127.0.0.1:54365
2013-10-31 18:37:27,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6835416087934708249_1220 src: /127.0.0.1:48024 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:37:27,264 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:27,945 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:27,946 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000004_0 not found in cache
2013-10-31 18:37:27,946 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000003_0 not found in cache
2013-10-31 18:37:27,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331047946
2013-10-31 18:37:28,413 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_412155634 given task: attempt_20131031182606197_0022_m_000006_0
2013-10-31 18:37:28,491 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-3539146678558007319_1213
2013-10-31 18:37:28,543 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_-1540473190 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:28,548 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28505 with signal TERM. Exit code 0
2013-10-31 18:37:28,707 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:28,707 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:28,707 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:28,707 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-1540473190 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:28,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:29,268 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_949917260 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:29,279 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28727 with signal TERM. Exit code 0
2013-10-31 18:37:29,442 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:29,442 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:29,442 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:29,442 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_949917260 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:29,746 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8363873052003505238_1058
2013-10-31 18:37:30,328 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3539146678558007319_1213 file build/test/data/dfs/data/data7/current/blk_-3539146678558007319 for deletion
2013-10-31 18:37:30,328 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3539146678558007319_1213 at file build/test/data/dfs/data/data7/current/blk_-3539146678558007319
2013-10-31 18:37:30,843 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:30,843 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000000_0 not found in cache
2013-10-31 18:37:30,843 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331050843
2013-10-31 18:37:30,862 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:30,862 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000001_0 not found in cache
2013-10-31 18:37:30,862 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331050862
2013-10-31 18:37:30,904 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:30,904 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000002_0 not found in cache
2013-10-31 18:37:30,905 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331050905
2013-10-31 18:37:31,549 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_-1495739159 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:31,551 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_-1217830969 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:31,560 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28500 with signal TERM. Exit code 0
2013-10-31 18:37:31,564 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28507 with signal TERM. Exit code 0
2013-10-31 18:37:31,755 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:31,755 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:31,755 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:31,755 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-1495739159 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:31,787 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:31,787 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:31,787 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:31,788 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-1217830969 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:31,836 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000006_0 0.0% setup
2013-10-31 18:37:31,839 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000006_0 is done.
2013-10-31 18:37:31,839 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000006_0  was -1
2013-10-31 18:37:31,840 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:31,847 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000006_0' has completed task_20131031182606197_0022_m_000006 successfully.
2013-10-31 18:37:31,849 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000000_0' to tip task_20131031182606197_0022_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:31,851 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000000
2013-10-31 18:37:31,851 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000001_0' to tip task_20131031182606197_0022_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:31,852 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000001
2013-10-31 18:37:31,854 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:37:31,855 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:37:31,855 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000000_0 which needs 1 slots
2013-10-31 18:37:31,855 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000000_0 which needs 1 slots
2013-10-31 18:37:31,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000001_0 which needs 1 slots
2013-10-31 18:37:31,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0022_m_000001_0 which needs 1 slots
2013-10-31 18:37:31,868 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000002_0' to tip task_20131031182606197_0022_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:31,869 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000002
2013-10-31 18:37:31,869 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000003_0' to tip task_20131031182606197_0022_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:31,870 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000003
2013-10-31 18:37:31,872 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:37:31,873 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:37:31,873 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000002_0 which needs 1 slots
2013-10-31 18:37:31,873 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000002_0 which needs 1 slots
2013-10-31 18:37:31,874 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000003_0 which needs 1 slots
2013-10-31 18:37:31,874 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0022_m_000003_0 which needs 1 slots
2013-10-31 18:37:31,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken	dst=null	perm=null
2013-10-31 18:37:31,882 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50656, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8993012588869726418_1226, duration: 388992
2013-10-31 18:37:31,886 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0022/attempt_20131031182606197_0022_m_000000_0. Attempting to reuse: jvm_20131031182606197_0022_m_412155634
2013-10-31 18:37:31,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml	dst=null	perm=null
2013-10-31 18:37:31,889 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43855, bytes: 27712, op: HDFS_READ, cliID: DFSClient_843330289, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 171489
2013-10-31 18:37:31,891 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_412155634 given task: attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:31,894 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0021_m_-536120217
2013-10-31 18:37:31,898 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28295 with signal TERM. Exit code 0
2013-10-31 18:37:31,898 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_-480791909
2013-10-31 18:37:31,899 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_-480791909 spawned.
2013-10-31 18:37:31,900 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000001_0/taskjvm.sh
2013-10-31 18:37:31,907 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000004_0' to tip task_20131031182606197_0022_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:37:31,907 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000004
2013-10-31 18:37:31,908 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:37:31,908 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000004_0 which needs 1 slots
2013-10-31 18:37:31,908 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000004_0 which needs 1 slots
2013-10-31 18:37:31,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken	dst=null	perm=null
2013-10-31 18:37:31,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50659, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8993012588869726418_1226, duration: 129469
2013-10-31 18:37:31,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml	dst=null	perm=null
2013-10-31 18:37:31,917 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43858, bytes: 27712, op: HDFS_READ, cliID: DFSClient_-1894480040, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 166859
2013-10-31 18:37:31,930 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:31,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar	dst=null	perm=null
2013-10-31 18:37:31,943 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43859, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1894480040, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6835416087934708249_1220, duration: 660348
2013-10-31 18:37:31,970 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:31,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar	dst=null	perm=null
2013-10-31 18:37:31,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50664, bytes: 239915, op: HDFS_READ, cliID: DFSClient_843330289, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6835416087934708249_1220, duration: 716706
2013-10-31 18:37:31,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=null
2013-10-31 18:37:31,996 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_-1409545061
2013-10-31 18:37:31,997 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_-1409545061 spawned.
2013-10-31 18:37:31,999 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000004_0/taskjvm.sh
2013-10-31 18:37:32,001 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47753, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7549849351233677898_1221, duration: 204185
2013-10-31 18:37:32,017 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:32,017 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:32,017 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:32,018 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-536120217 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:37:32,234 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_1366848033
2013-10-31 18:37:32,235 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_1366848033 spawned.
2013-10-31 18:37:32,236 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000002_0/taskjvm.sh
2013-10-31 18:37:32,237 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_959861597
2013-10-31 18:37:32,237 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_959861597 spawned.
2013-10-31 18:37:32,238 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000003_0/taskjvm.sh
2013-10-31 18:37:32,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:37:32,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:32,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:32,635 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48038, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-677913094566701302_1219, duration: 130964
2013-10-31 18:37:32,640 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000. blk_-9124557202898747765_1227
2013-10-31 18:37:32,659 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9124557202898747765_1227 src: /127.0.0.1:43865 dest: /127.0.0.1:59471
2013-10-31 18:37:32,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9124557202898747765_1227 src: /127.0.0.1:47757 dest: /127.0.0.1:37740
2013-10-31 18:37:32,661 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9124557202898747765_1227 src: /127.0.0.1:50670 dest: /127.0.0.1:34578
2013-10-31 18:37:32,664 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50670, dest: /127.0.0.1:34578, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9124557202898747765_1227, duration: 1533595
2013-10-31 18:37:32,664 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9124557202898747765_1227 terminating
2013-10-31 18:37:32,664 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47757, dest: /127.0.0.1:37740, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9124557202898747765_1227, duration: 1893040
2013-10-31 18:37:32,664 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9124557202898747765_1227 terminating
2013-10-31 18:37:32,665 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43865, dest: /127.0.0.1:59471, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9124557202898747765_1227, duration: 2401434
2013-10-31 18:37:32,665 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9124557202898747765_1227 terminating
2013-10-31 18:37:32,666 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9124557202898747765_1227 size 16
2013-10-31 18:37:32,667 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:32,667 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:32,667 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9124557202898747765_1227 size 16
2013-10-31 18:37:32,668 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9124557202898747765_1227 size 16
2013-10-31 18:37:32,730 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:32,731 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000000_0 0.0% 
2013-10-31 18:37:32,794 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_-480791909 given task: attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:33,095 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_-1409545061 given task: attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:33,172 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_959861597 given task: attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:33,178 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_1366848033 given task: attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:33,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=null
2013-10-31 18:37:33,302 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48046, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7549849351233677898_1221, duration: 174492
2013-10-31 18:37:33,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:37:33,344 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47766, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 128518
2013-10-31 18:37:33,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,530 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001. blk_6604687767579012569_1228
2013-10-31 18:37:33,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6604687767579012569_1228 src: /127.0.0.1:48052 dest: /127.0.0.1:54365
2013-10-31 18:37:33,569 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6604687767579012569_1228 src: /127.0.0.1:47770 dest: /127.0.0.1:37740
2013-10-31 18:37:33,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6604687767579012569_1228 src: /127.0.0.1:50683 dest: /127.0.0.1:34578
2013-10-31 18:37:33,572 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50683, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6604687767579012569_1228, duration: 1699662
2013-10-31 18:37:33,572 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6604687767579012569_1228 terminating
2013-10-31 18:37:33,572 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47770, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6604687767579012569_1228, duration: 1948901
2013-10-31 18:37:33,573 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6604687767579012569_1228 terminating
2013-10-31 18:37:33,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48052, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6604687767579012569_1228, duration: 2277339
2013-10-31 18:37:33,573 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6604687767579012569_1228 terminating
2013-10-31 18:37:33,575 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6604687767579012569_1228 size 8
2013-10-31 18:37:33,577 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6604687767579012569_1228 size 8
2013-10-31 18:37:33,577 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6604687767579012569_1228 size 8
2013-10-31 18:37:33,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=null
2013-10-31 18:37:33,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50684, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000004_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7549849351233677898_1221, duration: 157491
2013-10-31 18:37:33,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:37:33,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50687, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000004_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 116780
2013-10-31 18:37:33,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=null
2013-10-31 18:37:33,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split	dst=null	perm=null
2013-10-31 18:37:33,689 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47776, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7549849351233677898_1221, duration: 168630
2013-10-31 18:37:33,690 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50689, bytes: 1262, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7549849351233677898_1221, duration: 157899
2013-10-31 18:37:33,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:37:33,728 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50690, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 114012
2013-10-31 18:37:33,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:37:33,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50691, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 102943
2013-10-31 18:37:33,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,807 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004 from client DFSClient_attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:33,808 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:33,808 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1203 Total time for transactions(ms): 25Number of transactions batched in Syncs: 109 Number of syncs: 832 SyncTimes(ms): 63288 13925 
2013-10-31 18:37:33,852 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:33,853 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000004_0 0.0% 
2013-10-31 18:37:33,912 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003. blk_-4272970350228172538_1231
2013-10-31 18:37:33,912 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002. blk_-6800859378468113558_1231
2013-10-31 18:37:33,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4272970350228172538_1231 src: /127.0.0.1:43889 dest: /127.0.0.1:59471
2013-10-31 18:37:33,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6800859378468113558_1231 src: /127.0.0.1:50693 dest: /127.0.0.1:34578
2013-10-31 18:37:33,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4272970350228172538_1231 src: /127.0.0.1:47782 dest: /127.0.0.1:37740
2013-10-31 18:37:33,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6800859378468113558_1231 src: /127.0.0.1:48066 dest: /127.0.0.1:54365
2013-10-31 18:37:33,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4272970350228172538_1231 src: /127.0.0.1:50696 dest: /127.0.0.1:34578
2013-10-31 18:37:33,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6800859378468113558_1231 src: /127.0.0.1:47785 dest: /127.0.0.1:37740
2013-10-31 18:37:33,941 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50696, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4272970350228172538_1231, duration: 592109
2013-10-31 18:37:33,941 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47785, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6800859378468113558_1231, duration: 2754585
2013-10-31 18:37:33,941 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47782, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4272970350228172538_1231, duration: 2994972
2013-10-31 18:37:33,941 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4272970350228172538_1231 terminating
2013-10-31 18:37:33,941 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48066, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6800859378468113558_1231, duration: 3174371
2013-10-31 18:37:33,941 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6800859378468113558_1231 size 8
2013-10-31 18:37:33,941 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6800859378468113558_1231 terminating
2013-10-31 18:37:33,942 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43889, dest: /127.0.0.1:59471, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4272970350228172538_1231, duration: 3355272
2013-10-31 18:37:33,942 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6800859378468113558_1231 terminating
2013-10-31 18:37:33,942 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4272970350228172538_1231 terminating
2013-10-31 18:37:33,941 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4272970350228172538_1231 terminating
2013-10-31 18:37:33,942 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50693, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6800859378468113558_1231, duration: 3529923
2013-10-31 18:37:33,942 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4272970350228172538_1231 size 8
2013-10-31 18:37:33,943 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6800859378468113558_1231 terminating
2013-10-31 18:37:33,943 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:33,943 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:33,944 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6800859378468113558_1231 size 8
2013-10-31 18:37:33,944 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4272970350228172538_1231 size 8
2013-10-31 18:37:33,944 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4272970350228172538_1231 size 8
2013-10-31 18:37:33,944 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:33,944 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:33,975 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:33,975 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:33,983 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6800859378468113558_1231 size 8
2013-10-31 18:37:33,992 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:33,992 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000003_0 0.0% 
2013-10-31 18:37:33,994 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:33,994 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000002_0 0.0% 
2013-10-31 18:37:34,019 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:34,020 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000001_0 0.0% 
2013-10-31 18:37:34,859 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:34,859 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:34,876 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:34,876 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:34,912 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:35,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0	dst=null	perm=null
2013-10-31 18:37:35,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0	dst=null	perm=null
2013-10-31 18:37:35,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0	dst=null	perm=null
2013-10-31 18:37:35,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0	dst=null	perm=null
2013-10-31 18:37:35,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0	dst=null	perm=null
2013-10-31 18:37:35,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0	dst=null	perm=null
2013-10-31 18:37:35,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0	dst=null	perm=null
2013-10-31 18:37:35,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0	dst=null	perm=null
2013-10-31 18:37:35,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0	dst=null	perm=null
2013-10-31 18:37:35,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0	dst=null	perm=null
2013-10-31 18:37:36,228 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:7+7
2013-10-31 18:37:36,230 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000001_0 is done.
2013-10-31 18:37:36,230 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000001_0  was -1
2013-10-31 18:37:36,231 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:37:36,520 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:28+2
2013-10-31 18:37:36,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000004_0 is done.
2013-10-31 18:37:36,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000004_0  was -1
2013-10-31 18:37:36,523 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:36,618 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:21+7
2013-10-31 18:37:36,618 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:14+7
2013-10-31 18:37:36,619 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000003_0 is done.
2013-10-31 18:37:36,620 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000003_0  was -1
2013-10-31 18:37:36,620 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000002_0 is done.
2013-10-31 18:37:36,620 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000002_0  was -1
2013-10-31 18:37:36,621 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:37:36,621 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:36,855 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0022_m_000006_0
2013-10-31 18:37:36,855 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0022_m_000006_0
2013-10-31 18:37:36,855 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000006_0 not found in cache
2013-10-31 18:37:37,863 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000001_0' has completed task_20131031182606197_0022_m_000001 successfully.
2013-10-31 18:37:37,880 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000002_0' has completed task_20131031182606197_0022_m_000002 successfully.
2013-10-31 18:37:37,881 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000003_0' has completed task_20131031182606197_0022_m_000003 successfully.
2013-10-31 18:37:37,916 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000004_0' has completed task_20131031182606197_0022_m_000004 successfully.
2013-10-31 18:37:38,007 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:37:38,011 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:37:38,012 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000000_0 is done.
2013-10-31 18:37:38,013 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000000_0  was -1
2013-10-31 18:37:38,013 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:40,870 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000000_0' has completed task_20131031182606197_0022_m_000000 successfully.
2013-10-31 18:37:40,874 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0022_m_000005_0' to tip task_20131031182606197_0022_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:40,876 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:37:40,877 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000005_0 which needs 1 slots
2013-10-31 18:37:40,877 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000005_0 which needs 1 slots
2013-10-31 18:37:40,911 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0022/attempt_20131031182606197_0022_m_000005_0. Attempting to reuse: jvm_20131031182606197_0022_m_412155634
2013-10-31 18:37:41,543 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_412155634 given task: attempt_20131031182606197_0022_m_000005_0
2013-10-31 18:37:41,637 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000005_0 0.0% 
2013-10-31 18:37:41,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary	dst=null	perm=null
2013-10-31 18:37:41,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:41,649 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_SUCCESS from client DFSClient_attempt_20131031182606197_0022_m_000005_0
2013-10-31 18:37:41,649 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0022_m_000005_0
2013-10-31 18:37:41,653 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,653 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7735072202814239768 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7735072202814239768 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7735072202814239768 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_20087189836750365 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:41,654 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_20087189836750365 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,655 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_20087189836750365 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022	dst=null	perm=null
2013-10-31 18:37:43,494 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_20087189836750365_1223 blk_-7549849351233677898_1221 blk_-7735072202814239768_1222 blk_6835416087934708249_1220
2013-10-31 18:37:43,494 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-7549849351233677898_1221 blk_-7735072202814239768_1222 blk_6835416087934708249_1220
2013-10-31 18:37:44,134 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7735072202814239768_1222 file build/test/data/dfs/data/data4/current/blk_-7735072202814239768 for deletion
2013-10-31 18:37:44,134 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data3/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:44,134 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7735072202814239768_1222 at file build/test/data/dfs/data/data4/current/blk_-7735072202814239768
2013-10-31 18:37:44,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_20087189836750365_1223 file build/test/data/dfs/data/data3/current/blk_20087189836750365 for deletion
2013-10-31 18:37:44,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data3/current/blk_-7549849351233677898
2013-10-31 18:37:44,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data4/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:44,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_20087189836750365_1223 at file build/test/data/dfs/data/data3/current/blk_20087189836750365
2013-10-31 18:37:44,136 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data4/current/blk_6835416087934708249
2013-10-31 18:37:44,612 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000005_0 0.0% cleanup
2013-10-31 18:37:44,614 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000005_0 is done.
2013-10-31 18:37:44,614 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000005_0  was -1
2013-10-31 18:37:44,615 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:45,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7735072202814239768_1222 file build/test/data/dfs/data/data7/current/blk_-7735072202814239768 for deletion
2013-10-31 18:37:45,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data8/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:45,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7735072202814239768_1222 at file build/test/data/dfs/data/data7/current/blk_-7735072202814239768
2013-10-31 18:37:45,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data7/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:45,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data8/current/blk_-7549849351233677898
2013-10-31 18:37:45,334 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data7/current/blk_6835416087934708249
2013-10-31 18:37:46,495 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_20087189836750365_1223 blk_-7549849351233677898_1221 blk_-7735072202814239768_1222 blk_6835416087934708249_1220
2013-10-31 18:37:46,495 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_20087189836750365_1223 blk_-7549849351233677898_1221 blk_6835416087934708249_1220
2013-10-31 18:37:46,886 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000005_0' has completed task_20131031182606197_0022_m_000005 successfully.
2013-10-31 18:37:46,971 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0022 has completed successfully.
2013-10-31 18:37:46,971 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0022,submitTime=1383244643828,launchTime=1383244643925,firstMapTaskLaunchTime=1383244651849,firstJobSetupTaskLaunchTime=1383244645835,firstJobCleanupTaskLaunchTime=1383244660874,finishTime=1383244666970,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[67B35E38CF3745D68B988F9D0508F6B3/FEE9B5025176410C887F313126C4572F] test/(1/1) ...edpipesplatform/ungrouped
2013-10-31 18:37:46,979 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C. blk_-6648583397754692178_1232
2013-10-31 18:37:46,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6648583397754692178_1232 src: /127.0.0.1:47789 dest: /127.0.0.1:37740
2013-10-31 18:37:46,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6648583397754692178_1232 src: /127.0.0.1:43899 dest: /127.0.0.1:59471
2013-10-31 18:37:46,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6648583397754692178_1232 src: /127.0.0.1:50703 dest: /127.0.0.1:34578
2013-10-31 18:37:46,993 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50703, dest: /127.0.0.1:34578, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6648583397754692178_1232, duration: 4295873
2013-10-31 18:37:46,994 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6648583397754692178_1232 terminating
2013-10-31 18:37:46,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43899, dest: /127.0.0.1:59471, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6648583397754692178_1232, duration: 5158502
2013-10-31 18:37:46,994 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6648583397754692178_1232 terminating
2013-10-31 18:37:46,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47789, dest: /127.0.0.1:37740, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6648583397754692178_1232, duration: 7000567
2013-10-31 18:37:46,995 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6648583397754692178_1232 size 25809
2013-10-31 18:37:46,995 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6648583397754692178_1232 terminating
2013-10-31 18:37:46,999 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6648583397754692178_1232 size 25809
2013-10-31 18:37:47,000 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C from client DFSClient_874298567
2013-10-31 18:37:47,000 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C is closed by DFSClient_874298567
2013-10-31 18:37:47,001 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6648583397754692178_1232 size 25809
2013-10-31 18:37:47,008 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:47,009 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000000_0'
2013-10-31 18:37:47,009 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000001_0'
2013-10-31 18:37:47,009 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000005_0'
2013-10-31 18:37:47,010 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8993012588869726418 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:47,010 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000006_0'
2013-10-31 18:37:47,010 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8993012588869726418 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:47,011 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8993012588869726418 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:47,011 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000004_0'
2013-10-31 18:37:47,011 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:47,012 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0022 being deleted.
2013-10-31 18:37:47,012 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000002_0'
2013-10-31 18:37:47,013 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000003_0'
2013-10-31 18:37:47,014 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0022_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:47,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022	dst=null	perm=null
2013-10-31 18:37:47,019 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary
2013-10-31 18:37:47,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=null
2013-10-31 18:37:47,040 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 18:37:47,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000	dst=null	perm=null
2013-10-31 18:37:47,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001	dst=null	perm=null
2013-10-31 18:37:47,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002	dst=null	perm=null
2013-10-31 18:37:47,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003	dst=null	perm=null
2013-10-31 18:37:47,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004	dst=null	perm=null
2013-10-31 18:37:47,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000	dst=null	perm=null
2013-10-31 18:37:47,050 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43902, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9124557202898747765_1227, duration: 280131
2013-10-31 18:37:47,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001	dst=null	perm=null
2013-10-31 18:37:47,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48077, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6604687767579012569_1228, duration: 283693
2013-10-31 18:37:47,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002	dst=null	perm=null
2013-10-31 18:37:47,057 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47795, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6800859378468113558_1231, duration: 260506
2013-10-31 18:37:47,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003	dst=null	perm=null
2013-10-31 18:37:47,060 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47796, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4272970350228172538_1231, duration: 260316
2013-10-31 18:37:47,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004	dst=null	perm=null
2013-10-31 18:37:47,062 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/ungrouped
2013-10-31 18:37:47,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped	dst=null	perm=null
2013-10-31 18:37:47,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000	dst=null	perm=null
2013-10-31 18:37:47,071 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43906, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9124557202898747765_1227, duration: 337155
2013-10-31 18:37:47,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001	dst=null	perm=null
2013-10-31 18:37:47,075 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50710, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6604687767579012569_1228, duration: 266014
2013-10-31 18:37:47,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002	dst=null	perm=null
2013-10-31 18:37:47,079 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47799, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6800859378468113558_1231, duration: 269163
2013-10-31 18:37:47,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003	dst=null	perm=null
2013-10-31 18:37:47,084 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43909, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4272970350228172538_1231, duration: 264186
2013-10-31 18:37:47,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004	dst=null	perm=null
2013-10-31 18:37:47,108 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:37:47,108 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:37:47,136 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third] starting
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  sink: Hfs["TextDelimited[['ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second"]
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  sink: Hfs["TextDelimited[['ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third"]
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  sink: Hfs["TextDelimited[['ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first"]
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  parallel execution is enabled: true
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  starting jobs: 3
2013-10-31 18:37:47,137 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [third]  allocating threads: 3
2013-10-31 18:37:47,138 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] starting step: (1/3) ...latform/chainedtaps/first
2013-10-31 18:37:47,141 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:37:47,141 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:37:47,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:47,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:37:47,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:47,234 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar. blk_-4387391707925617419_1233
2013-10-31 18:37:47,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:50713 dest: /127.0.0.1:34578
2013-10-31 18:37:47,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:47802 dest: /127.0.0.1:37740
2013-10-31 18:37:47,239 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:43912 dest: /127.0.0.1:59471
2013-10-31 18:37:47,252 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3853691654878838440_1011
2013-10-31 18:37:47,252 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43912, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 9763240
2013-10-31 18:37:47,253 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4387391707925617419_1233 terminating
2013-10-31 18:37:47,257 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:47,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47802, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4387391707925617419_1233, duration: 10688483
2013-10-31 18:37:47,356 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4387391707925617419_1233 terminating
2013-10-31 18:37:47,356 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:47,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50713, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4387391707925617419_1233, duration: 114211192
2013-10-31 18:37:47,357 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4387391707925617419_1233 terminating
2013-10-31 18:37:47,359 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar from client DFSClient_-1596270109
2013-10-31 18:37:47,360 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:37:47,360 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:47,864 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data6/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:47,864 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_20087189836750365_1223 file build/test/data/dfs/data/data5/current/blk_20087189836750365 for deletion
2013-10-31 18:37:47,864 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data6/current/blk_-7549849351233677898
2013-10-31 18:37:47,864 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_20087189836750365_1223 at file build/test/data/dfs/data/data5/current/blk_20087189836750365
2013-10-31 18:37:47,864 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data5/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:47,865 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data5/current/blk_6835416087934708249
2013-10-31 18:37:48,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7735072202814239768_1222 file build/test/data/dfs/data/data2/current/blk_-7735072202814239768 for deletion
2013-10-31 18:37:48,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data1/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:48,261 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_20087189836750365_1223 file build/test/data/dfs/data/data1/current/blk_20087189836750365 for deletion
2013-10-31 18:37:48,262 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data2/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:48,467 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data1/current/blk_-7549849351233677898
2013-10-31 18:37:48,467 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7735072202814239768_1222 at file build/test/data/dfs/data/data2/current/blk_-7735072202814239768
2013-10-31 18:37:48,468 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_20087189836750365_1223 at file build/test/data/dfs/data/data1/current/blk_20087189836750365
2013-10-31 18:37:48,468 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data2/current/blk_6835416087934708249
2013-10-31 18:37:48,771 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar. New replication is 10
2013-10-31 18:37:48,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=null
2013-10-31 18:37:48,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,782 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:37:48,786 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:48,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:48,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,800 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split. New replication is 10
2013-10-31 18:37:48,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=null
2013-10-31 18:37:48,809 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split. blk_-4526157860798952037_1234
2013-10-31 18:37:48,811 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:50716 dest: /127.0.0.1:34578
2013-10-31 18:37:48,812 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:47805 dest: /127.0.0.1:37740
2013-10-31 18:37:48,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:43915 dest: /127.0.0.1:59471
2013-10-31 18:37:48,816 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:48090 dest: /127.0.0.1:54365
2013-10-31 18:37:48,836 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48090, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4526157860798952037_1234, duration: 19166093
2013-10-31 18:37:48,838 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,838 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43915, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4526157860798952037_1234, duration: 3939188
2013-10-31 18:37:48,844 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,845 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47805, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4526157860798952037_1234, duration: 11223296
2013-10-31 18:37:48,846 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,846 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,846 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50716, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4526157860798952037_1234, duration: 12256679
2013-10-31 18:37:48,847 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,847 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,847 INFO  datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:37:48,853 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split from client DFSClient_-1596270109
2013-10-31 18:37:48,854 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split is closed by DFSClient_-1596270109
2013-10-31 18:37:48,854 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,856 INFO  datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 6ms
2013-10-31 18:37:48,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,870 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo. blk_-2296380649723109786_1235
2013-10-31 18:37:48,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2296380649723109786_1235 src: /127.0.0.1:43917 dest: /127.0.0.1:59471
2013-10-31 18:37:48,874 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2296380649723109786_1235 src: /127.0.0.1:50721 dest: /127.0.0.1:34578
2013-10-31 18:37:48,875 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2296380649723109786_1235 src: /127.0.0.1:47810 dest: /127.0.0.1:37740
2013-10-31 18:37:48,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47810, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2296380649723109786_1235, duration: 69935
2013-10-31 18:37:48,879 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2296380649723109786_1235 terminating
2013-10-31 18:37:48,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50721, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2296380649723109786_1235, duration: 998864
2013-10-31 18:37:48,880 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2296380649723109786_1235 terminating
2013-10-31 18:37:48,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2296380649723109786_1235 size 156
2013-10-31 18:37:48,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43917, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2296380649723109786_1235, duration: 1929153
2013-10-31 18:37:48,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2296380649723109786_1235 size 156
2013-10-31 18:37:48,881 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2296380649723109786_1235 terminating
2013-10-31 18:37:48,884 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2296380649723109786_1235 size 156
2013-10-31 18:37:48,885 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:37:48,885 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:37:48,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,908 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml. blk_2168431696822472542_1236
2013-10-31 18:37:48,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2168431696822472542_1236 src: /127.0.0.1:50723 dest: /127.0.0.1:34578
2013-10-31 18:37:48,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2168431696822472542_1236 src: /127.0.0.1:43921 dest: /127.0.0.1:59471
2013-10-31 18:37:48,913 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2168431696822472542_1236 src: /127.0.0.1:47813 dest: /127.0.0.1:37740
2013-10-31 18:37:48,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47813, dest: /127.0.0.1:37740, bytes: 28401, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2168431696822472542_1236, duration: 258990
2013-10-31 18:37:48,916 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2168431696822472542_1236 terminating
2013-10-31 18:37:48,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43921, dest: /127.0.0.1:59471, bytes: 28401, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2168431696822472542_1236, duration: 1003364
2013-10-31 18:37:48,917 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2168431696822472542_1236 terminating
2013-10-31 18:37:48,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50723, dest: /127.0.0.1:34578, bytes: 28401, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2168431696822472542_1236, duration: 1806584
2013-10-31 18:37:48,918 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1793)) - Reconciled asynchronous block scan with filesystem. 0 blocks concurrently deleted during scan, 2 blocks concurrently added during scan, 0 ongoing creations ignored
2013-10-31 18:37:48,918 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2168431696822472542_1236 terminating
2013-10-31 18:37:48,918 INFO  datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 1 ms
2013-10-31 18:37:48,917 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2168431696822472542_1236 size 28401
2013-10-31 18:37:48,921 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml from client DFSClient_-1596270109
2013-10-31 18:37:48,921 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:37:48,928 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2168431696822472542_1236 size 28401
2013-10-31 18:37:48,929 INFO  hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:59471, blocks: 58, processing time: 8 msecs
2013-10-31 18:37:48,929 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2168431696822472542_1236 size 28401
2013-10-31 18:37:48,930 INFO  datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 58 blocks took 3 msec to generate and 10 msecs for RPC and NN processing
2013-10-31 18:37:48,930 WARN  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3690)) - BLOCK* NameSystem.addStoredBlock: Redundant addStoredBlock request received for blk_2168431696822472542_1236 on 127.0.0.1:59471 size 28401
2013-10-31 18:37:48,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=null
2013-10-31 18:37:48,936 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50727, bytes: 28625, op: HDFS_READ, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2168431696822472542_1236, duration: 399373
2013-10-31 18:37:48,955 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0023: nMaps=4 nReduces=1 max=-1
2013-10-31 18:37:48,955 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0023 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:37:48,955 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0023
2013-10-31 18:37:48,955 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0023	RESULT=SUCCESS
2013-10-31 18:37:48,956 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0023
2013-10-31 18:37:48,957 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] submitted hadoop job: job_20131031182606197_0023
2013-10-31 18:37:48,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,988 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml. blk_-2588845235276228695_1238
2013-10-31 18:37:48,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2588845235276228695_1238 src: /127.0.0.1:50728 dest: /127.0.0.1:34578
2013-10-31 18:37:48,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2588845235276228695_1238 src: /127.0.0.1:47817 dest: /127.0.0.1:37740
2013-10-31 18:37:48,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2588845235276228695_1238 src: /127.0.0.1:43927 dest: /127.0.0.1:59471
2013-10-31 18:37:48,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43927, dest: /127.0.0.1:59471, bytes: 28466, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2588845235276228695_1238, duration: 566302
2013-10-31 18:37:48,998 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2588845235276228695_1238 terminating
2013-10-31 18:37:48,998 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2588845235276228695_1238 size 28466
2013-10-31 18:37:48,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47817, dest: /127.0.0.1:37740, bytes: 28466, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2588845235276228695_1238, duration: 1386322
2013-10-31 18:37:48,999 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2588845235276228695_1238 terminating
2013-10-31 18:37:48,999 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50728, dest: /127.0.0.1:34578, bytes: 28466, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2588845235276228695_1238, duration: 2470684
2013-10-31 18:37:48,999 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2588845235276228695_1238 terminating
2013-10-31 18:37:49,002 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml from client DFSClient_-1404978550
2013-10-31 18:37:49,002 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml is closed by DFSClient_-1404978550
2013-10-31 18:37:49,003 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2588845235276228695_1238 size 28466
2013-10-31 18:37:49,003 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2588845235276228695_1238 size 28466
2013-10-31 18:37:49,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:49,262 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken. blk_121557755361841184_1239
2013-10-31 18:37:49,264 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_121557755361841184_1239 src: /127.0.0.1:47819 dest: /127.0.0.1:37740
2013-10-31 18:37:49,265 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_121557755361841184_1239 src: /127.0.0.1:43929 dest: /127.0.0.1:59471
2013-10-31 18:37:49,267 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_121557755361841184_1239 src: /127.0.0.1:48104 dest: /127.0.0.1:54365
2013-10-31 18:37:49,270 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48104, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_121557755361841184_1239, duration: 66637
2013-10-31 18:37:49,270 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_121557755361841184_1239 terminating
2013-10-31 18:37:49,271 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43929, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 851903
2013-10-31 18:37:49,271 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_121557755361841184_1239 terminating
2013-10-31 18:37:49,271 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47819, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_121557755361841184_1239, duration: 1696622
2013-10-31 18:37:49,272 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_121557755361841184_1239 size 116
2013-10-31 18:37:49,272 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_121557755361841184_1239 terminating
2013-10-31 18:37:49,274 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_121557755361841184_1239 size 116
2013-10-31 18:37:49,274 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken from client DFSClient_-1596270109
2013-10-31 18:37:49,275 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:37:49,275 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_121557755361841184_1239 size 116
2013-10-31 18:37:49,279 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken
2013-10-31 18:37:49,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:37:49,284 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47822, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2296380649723109786_1235, duration: 284261
2013-10-31 18:37:49,285 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0023 = 1449. Number of splits = 4
2013-10-31 18:37:49,285 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,285 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,288 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0023 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:37:49,289 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0023 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:37:49,496 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-4387391707925617419_1233 to datanode(s) 127.0.0.1:54365
2013-10-31 18:37:49,496 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_8993012588869726418_1226
2013-10-31 18:37:49,496 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_8993012588869726418_1226
2013-10-31 18:37:50,016 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0023_m_000005_0' to tip task_20131031182606197_0023_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:50,024 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:37:50,024 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000005_0 which needs 1 slots
2013-10-31 18:37:50,025 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000005_0 which needs 1 slots
2013-10-31 18:37:50,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken	dst=null	perm=null
2013-10-31 18:37:50,033 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43932, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 284802
2013-10-31 18:37:50,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=null
2013-10-31 18:37:50,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43934, bytes: 28625, op: HDFS_READ, cliID: DFSClient_-1069582265, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2168431696822472542_1236, duration: 439749
2013-10-31 18:37:50,062 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:50,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=null
2013-10-31 18:37:50,089 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43935, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1069582265, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 607562
2013-10-31 18:37:50,135 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8993012588869726418_1226 file build/test/data/dfs/data/data3/current/blk_8993012588869726418 for deletion
2013-10-31 18:37:50,136 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8993012588869726418_1226 at file build/test/data/dfs/data/data3/current/blk_8993012588869726418
2013-10-31 18:37:50,159 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0022_m_-480791909
2013-10-31 18:37:50,164 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29044 with signal TERM. Exit code 0
2013-10-31 18:37:50,164 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_-959828638
2013-10-31 18:37:50,164 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_-959828638 spawned.
2013-10-31 18:37:50,166 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000005_0/taskjvm.sh
2013-10-31 18:37:50,292 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0022_m_-480791909
2013-10-31 18:37:50,553 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:50,553 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:50,553 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:50,553 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_-480791909 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:51,261 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-4387391707925617419_1233 to 127.0.0.1:54365 
2013-10-31 18:37:51,262 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8993012588869726418_1226 file build/test/data/dfs/data/data1/current/blk_8993012588869726418 for deletion
2013-10-31 18:37:51,263 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8993012588869726418_1226 at file build/test/data/dfs/data/data1/current/blk_8993012588869726418
2013-10-31 18:37:51,264 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:48111 dest: /127.0.0.1:54365
2013-10-31 18:37:51,264 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-4387391707925617419_1233 to /127.0.0.1:54365
2013-10-31 18:37:51,265 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4387391707925617419_1233 src: /127.0.0.1:48111 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:37:51,267 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:51,303 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_-959828638 given task: attempt_20131031182606197_0023_m_000005_0
2013-10-31 18:37:51,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:52,011 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:52,012 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000000_0 not found in cache
2013-10-31 18:37:52,012 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000005_0 not found in cache
2013-10-31 18:37:52,012 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:52,012 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000001_0 not found in cache
2013-10-31 18:37:52,013 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000004_0 not found in cache
2013-10-31 18:37:52,013 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383331072013
2013-10-31 18:37:52,014 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:52,014 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383331072014
2013-10-31 18:37:52,014 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000002_0 not found in cache
2013-10-31 18:37:52,015 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000003_0 not found in cache
2013-10-31 18:37:52,015 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383331072015
2013-10-31 18:37:52,095 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_-1409545061 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,105 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29102 with signal TERM. Exit code 0
2013-10-31 18:37:52,189 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_1366848033 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,194 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29133 with signal TERM. Exit code 0
2013-10-31 18:37:52,194 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_959861597 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,201 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29132 with signal TERM. Exit code 0
2013-10-31 18:37:52,320 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,320 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,321 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:52,321 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_-1409545061 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:52,377 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,377 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,377 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:52,377 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_959861597 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:52,379 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,380 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,380 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:52,380 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_1366848033 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:52,497 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_8993012588869726418_1226
2013-10-31 18:37:52,652 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_412155634 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,661 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28886 with signal TERM. Exit code 0
2013-10-31 18:37:52,827 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,828 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,828 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:37:52,829 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_412155634 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:37:54,335 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8993012588869726418_1226 file build/test/data/dfs/data/data7/current/blk_8993012588869726418 for deletion
2013-10-31 18:37:54,336 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8993012588869726418_1226 at file build/test/data/dfs/data/data7/current/blk_8993012588869726418
2013-10-31 18:37:54,745 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000005_0 0.0% setup
2013-10-31 18:37:54,748 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000005_0 is done.
2013-10-31 18:37:54,749 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000005_0  was -1
2013-10-31 18:37:54,749 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:37:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,029 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000005_0' has completed task_20131031182606197_0023_m_000005 successfully.
2013-10-31 18:37:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,031 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000000_0' to tip task_20131031182606197_0023_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:56,032 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000000
2013-10-31 18:37:56,034 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:37:56,034 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000001_0' to tip task_20131031182606197_0023_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:37:56,034 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000000_0 which needs 1 slots
2013-10-31 18:37:56,034 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000001
2013-10-31 18:37:56,034 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000000_0 which needs 1 slots
2013-10-31 18:37:56,035 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:37:56,035 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000001_0 which needs 1 slots
2013-10-31 18:37:56,035 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000001_0 which needs 1 slots
2013-10-31 18:37:56,038 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken	dst=null	perm=null
2013-10-31 18:37:56,044 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43940, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 151311
2013-10-31 18:37:56,050 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,052 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_-806897
2013-10-31 18:37:56,053 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_-806897 spawned.
2013-10-31 18:37:56,054 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000000_0/taskjvm.sh
2013-10-31 18:37:56,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=null
2013-10-31 18:37:56,056 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,056 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 36 records
2013-10-31 18:37:56,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43942, bytes: 28625, op: HDFS_READ, cliID: DFSClient_168709840, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2168431696822472542_1236, duration: 168140
2013-10-31 18:37:56,067 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000002_0' to tip task_20131031182606197_0023_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:37:56,068 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000002
2013-10-31 18:37:56,069 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:37:56,069 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000003_0' to tip task_20131031182606197_0023_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:56,069 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000002_0 which needs 1 slots
2013-10-31 18:37:56,069 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000002_0 which needs 1 slots
2013-10-31 18:37:56,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken	dst=null	perm=null
2013-10-31 18:37:56,072 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000003
2013-10-31 18:37:56,074 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:37:56,074 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000003_0 which needs 1 slots
2013-10-31 18:37:56,074 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000003_0 which needs 1 slots
2013-10-31 18:37:56,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43943, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 147161
2013-10-31 18:37:56,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken	dst=null	perm=null
2013-10-31 18:37:56,077 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:56,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=null
2013-10-31 18:37:56,079 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48119, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_121557755361841184_1239, duration: 173004
2013-10-31 18:37:56,080 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47837, bytes: 28625, op: HDFS_READ, cliID: DFSClient_-2135715500, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2168431696822472542_1236, duration: 170721
2013-10-31 18:37:56,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml	dst=null	perm=null
2013-10-31 18:37:56,084 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50751, bytes: 28625, op: HDFS_READ, cliID: DFSClient_931646476, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2168431696822472542_1236, duration: 166213
2013-10-31 18:37:56,094 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:56,096 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:56,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=null
2013-10-31 18:37:56,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=null
2013-10-31 18:37:56,124 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48123, bytes: 239915, op: HDFS_READ, cliID: DFSClient_168709840, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4387391707925617419_1233, duration: 1370420
2013-10-31 18:37:56,124 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43950, bytes: 239915, op: HDFS_READ, cliID: DFSClient_931646476, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 1297164
2013-10-31 18:37:56,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar	dst=null	perm=null
2013-10-31 18:37:56,147 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43951, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2135715500, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 1719629
2013-10-31 18:37:56,196 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_525620828
2013-10-31 18:37:56,197 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_525620828 spawned.
2013-10-31 18:37:56,199 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000003_0/taskjvm.sh
2013-10-31 18:37:56,201 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_4777009
2013-10-31 18:37:56,202 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_4777009 spawned.
2013-10-31 18:37:56,203 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000001_0/taskjvm.sh
2013-10-31 18:37:56,220 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_1805283263
2013-10-31 18:37:56,221 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_1805283263 spawned.
2013-10-31 18:37:56,222 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000002_0/taskjvm.sh
2013-10-31 18:37:56,928 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_-806897 given task: attempt_20131031182606197_0023_m_000000_0
2013-10-31 18:37:57,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=null
2013-10-31 18:37:57,444 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50757, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4526157860798952037_1234, duration: 174400
2013-10-31 18:37:57,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:57,483 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48129, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 130611
2013-10-31 18:37:57,703 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_525620828 given task: attempt_20131031182606197_0023_m_000003_0
2013-10-31 18:37:57,714 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_1805283263 given task: attempt_20131031182606197_0023_m_000002_0
2013-10-31 18:37:57,727 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_4777009 given task: attempt_20131031182606197_0023_m_000001_0
2013-10-31 18:37:58,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=null
2013-10-31 18:37:58,199 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43962, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4526157860798952037_1234, duration: 130985
2013-10-31 18:37:58,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=null
2013-10-31 18:37:58,229 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50766, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4526157860798952037_1234, duration: 172932
2013-10-31 18:37:58,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split	dst=null	perm=null
2013-10-31 18:37:58,236 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48138, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4526157860798952037_1234, duration: 137475
2013-10-31 18:37:58,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:58,239 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48139, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 255778
2013-10-31 18:37:58,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:58,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48140, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 206052
2013-10-31 18:37:58,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:37:58,531 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47858, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 184039
2013-10-31 18:38:00,373 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:38:00,375 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000000_0 is done.
2013-10-31 18:38:00,375 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000000_0  was 54
2013-10-31 18:38:00,375 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:01,034 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0023_m_000005_0
2013-10-31 18:38:01,034 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0023_m_000005_0
2013-10-31 18:38:01,034 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0023_m_000005_0 not found in cache
2013-10-31 18:38:01,128 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:38:01,129 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000003_0 is done.
2013-10-31 18:38:01,129 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000003_0  was 53
2013-10-31 18:38:01,130 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:01,157 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:38:01,158 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000002_0 is done.
2013-10-31 18:38:01,159 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000002_0  was 73
2013-10-31 18:38:01,159 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:01,164 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:38:01,165 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000001_0 is done.
2013-10-31 18:38:01,165 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000001_0  was 74
2013-10-31 18:38:01,165 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:02,040 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000000_0' has completed task_20131031182606197_0023_m_000000 successfully.
2013-10-31 18:38:02,304 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0023_r_000000_0' to tip task_20131031182606197_0023_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:02,305 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000003_0' has completed task_20131031182606197_0023_m_000003 successfully.
2013-10-31 18:38:02,306 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:38:02,307 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_r_000000_0 which needs 1 slots
2013-10-31 18:38:02,307 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_r_000000_0 which needs 1 slots
2013-10-31 18:38:02,308 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000002_0' has completed task_20131031182606197_0023_m_000002 successfully.
2013-10-31 18:38:02,311 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000001_0' has completed task_20131031182606197_0023_m_000001 successfully.
2013-10-31 18:38:02,345 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_r_-739234499
2013-10-31 18:38:02,346 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_r_-739234499 spawned.
2013-10-31 18:38:02,347 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_r_000000_0/taskjvm.sh
2013-10-31 18:38:03,150 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_r_-739234499 given task: attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:08,841 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49809, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000000_0, duration: 10700822
2013-10-31 18:38:08,869 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44852, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000003_0, duration: 12762341
2013-10-31 18:38:08,886 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42177, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000002_0, duration: 12821022
2013-10-31 18:38:08,904 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40157, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000001_0, duration: 12829950
2013-10-31 18:38:09,655 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:09,695 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:09,757 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:09,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:09,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:09,993 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000. blk_-4840805767582090128_1240
2013-10-31 18:38:10,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4840805767582090128_1240 src: /127.0.0.1:50777 dest: /127.0.0.1:34578
2013-10-31 18:38:10,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4840805767582090128_1240 src: /127.0.0.1:43975 dest: /127.0.0.1:59471
2013-10-31 18:38:10,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4840805767582090128_1240 src: /127.0.0.1:47867 dest: /127.0.0.1:37740
2013-10-31 18:38:10,041 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47867, dest: /127.0.0.1:37740, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0023_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4840805767582090128_1240, duration: 1502776
2013-10-31 18:38:10,044 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4840805767582090128_1240 terminating
2013-10-31 18:38:10,045 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4840805767582090128_1240 size 140
2013-10-31 18:38:10,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43975, dest: /127.0.0.1:59471, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0023_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4840805767582090128_1240, duration: 6080313
2013-10-31 18:38:10,045 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4840805767582090128_1240 terminating
2013-10-31 18:38:10,046 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50777, dest: /127.0.0.1:34578, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0023_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4840805767582090128_1240, duration: 7341412
2013-10-31 18:38:10,047 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4840805767582090128_1240 terminating
2013-10-31 18:38:10,047 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4840805767582090128_1240 size 140
2013-10-31 18:38:10,048 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:10,049 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:10,049 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4840805767582090128_1240 size 140
2013-10-31 18:38:10,084 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0023_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:38:10,084 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:11,316 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0023_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:38:11,317 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:12,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0	dst=null	perm=null
2013-10-31 18:38:12,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:12,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:12,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0	dst=null	perm=null
2013-10-31 18:38:12,706 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:12,709 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:12,710 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_r_000000_0 is done.
2013-10-31 18:38:12,711 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_r_000000_0  was -1
2013-10-31 18:38:12,711 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:14,321 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_r_000000_0' has completed task_20131031182606197_0023_r_000000 successfully.
2013-10-31 18:38:14,325 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0023_m_000004_0' to tip task_20131031182606197_0023_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:14,329 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:38:14,330 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000004_0 which needs 1 slots
2013-10-31 18:38:14,330 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000004_0 which needs 1 slots
2013-10-31 18:38:14,367 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0023/attempt_20131031182606197_0023_m_000004_0. Attempting to reuse: jvm_20131031182606197_0023_m_-806897
2013-10-31 18:38:14,441 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_-806897 given task: attempt_20131031182606197_0023_m_000004_0
2013-10-31 18:38:14,565 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000004_0 0.0% 
2013-10-31 18:38:14,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary	dst=null	perm=null
2013-10-31 18:38:14,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:14,580 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_SUCCESS from client DFSClient_attempt_20131031182606197_0023_m_000004_0
2013-10-31 18:38:14,580 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0023_m_000004_0
2013-10-31 18:38:14,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:14,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:14,584 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2296380649723109786 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2296380649723109786 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2296380649723109786 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2168431696822472542 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2168431696822472542 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,585 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2168431696822472542 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023	dst=null	perm=null
2013-10-31 18:38:16,501 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-4387391707925617419_1233 blk_-4526157860798952037_1234 blk_2168431696822472542_1236 blk_-2296380649723109786_1235
2013-10-31 18:38:16,502 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-4387391707925617419_1233 blk_-4526157860798952037_1234
2013-10-31 18:38:17,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data3/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:17,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data3/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:17,145 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data3/current/blk_-4526157860798952037
2013-10-31 18:38:17,146 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data3/current/blk_-4387391707925617419
2013-10-31 18:38:17,520 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000004_0 0.0% cleanup
2013-10-31 18:38:17,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000004_0 is done.
2013-10-31 18:38:17,522 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000004_0  was -1
2013-10-31 18:38:17,522 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:17,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data6/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:17,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data5/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:17,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data6/current/blk_-4526157860798952037
2013-10-31 18:38:17,874 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2296380649723109786_1235 file build/test/data/dfs/data/data5/current/blk_-2296380649723109786 for deletion
2013-10-31 18:38:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data5/current/blk_-4387391707925617419
2013-10-31 18:38:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2168431696822472542_1236 file build/test/data/dfs/data/data6/current/blk_2168431696822472542 for deletion
2013-10-31 18:38:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2296380649723109786_1235 at file build/test/data/dfs/data/data5/current/blk_-2296380649723109786
2013-10-31 18:38:17,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2168431696822472542_1236 at file build/test/data/dfs/data/data6/current/blk_2168431696822472542
2013-10-31 18:38:19,330 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:19,330 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:19,502 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-4387391707925617419_1233 blk_-4526157860798952037_1234 blk_2168431696822472542_1236 blk_-2296380649723109786_1235
2013-10-31 18:38:19,502 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-4387391707925617419_1233 blk_-4526157860798952037_1234 blk_2168431696822472542_1236 blk_-2296380649723109786_1235
2013-10-31 18:38:20,334 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000004_0' has completed task_20131031182606197_0023_m_000004 successfully.
2013-10-31 18:38:20,700 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0023 has completed successfully.
2013-10-31 18:38:20,700 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0023,submitTime=1383244668926,launchTime=1383244669288,firstMapTaskLaunchTime=1383244676031,firstReduceTaskLaunchTime=1383244682303,firstJobSetupTaskLaunchTime=1383244670015,firstJobCleanupTaskLaunchTime=1383244694325,finishTime=1383244700700,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1C92A88E814146F3BAF77C456D0E6369/C85A09F2BAB6494E91954F0CB9E4B269] third/(1/3) ...latform/chainedtaps/first
2013-10-31 18:38:20,706 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E. blk_8583745150648525578_1241
2013-10-31 18:38:20,710 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8583745150648525578_1241 src: /127.0.0.1:50783 dest: /127.0.0.1:34578
2013-10-31 18:38:20,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8583745150648525578_1241 src: /127.0.0.1:48155 dest: /127.0.0.1:54365
2013-10-31 18:38:20,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8583745150648525578_1241 src: /127.0.0.1:47873 dest: /127.0.0.1:37740
2013-10-31 18:38:20,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47873, dest: /127.0.0.1:37740, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8583745150648525578_1241, duration: 4468659
2013-10-31 18:38:20,725 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8583745150648525578_1241 terminating
2013-10-31 18:38:20,725 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8583745150648525578_1241 size 28316
2013-10-31 18:38:20,726 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48155, dest: /127.0.0.1:54365, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8583745150648525578_1241, duration: 3954039
2013-10-31 18:38:20,727 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8583745150648525578_1241 terminating
2013-10-31 18:38:20,727 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50783, dest: /127.0.0.1:34578, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8583745150648525578_1241, duration: 3757484
2013-10-31 18:38:20,728 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8583745150648525578_1241 terminating
2013-10-31 18:38:20,733 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8583745150648525578_1241 size 28316
2013-10-31 18:38:20,734 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E from client DFSClient_-1404978550
2013-10-31 18:38:20,734 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E is closed by DFSClient_-1404978550
2013-10-31 18:38:20,735 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8583745150648525578_1241 size 28316
2013-10-31 18:38:20,741 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:20,742 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000000_0'
2013-10-31 18:38:20,743 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000004_0'
2013-10-31 18:38:20,744 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000005_0'
2013-10-31 18:38:20,744 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_121557755361841184 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:20,744 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_r_000000_0'
2013-10-31 18:38:20,744 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_121557755361841184 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:20,745 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_121557755361841184 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:20,745 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000002_0'
2013-10-31 18:38:20,745 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000001_0'
2013-10-31 18:38:20,746 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000003_0'
2013-10-31 18:38:20,747 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0023_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:20,751 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] starting step: (2/3) ...atform/chainedtaps/second
2013-10-31 18:38:20,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023	dst=null	perm=null
2013-10-31 18:38:20,757 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:38:20,757 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:38:20,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:20,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:38:20,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:20,779 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar. blk_5873056186943798323_1242
2013-10-31 18:38:20,781 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:48158 dest: /127.0.0.1:54365
2013-10-31 18:38:20,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:50788 dest: /127.0.0.1:34578
2013-10-31 18:38:20,784 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:43986 dest: /127.0.0.1:59471
2013-10-31 18:38:20,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43986, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5873056186943798323_1242, duration: 2854629
2013-10-31 18:38:20,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5873056186943798323_1242 terminating
2013-10-31 18:38:20,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50788, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5873056186943798323_1242, duration: 3239413
2013-10-31 18:38:20,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5873056186943798323_1242 terminating
2013-10-31 18:38:20,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48158, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5873056186943798323_1242, duration: 3759534
2013-10-31 18:38:20,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5873056186943798323_1242 terminating
2013-10-31 18:38:20,792 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:20,793 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar from client DFSClient_-1596270109
2013-10-31 18:38:20,793 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:38:20,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:20,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:21,202 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar. New replication is 10
2013-10-31 18:38:21,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=null
2013-10-31 18:38:21,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,217 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:38:21,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first	dst=null	perm=null
2013-10-31 18:38:21,223 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:38:21,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	dst=null	perm=null
2013-10-31 18:38:21,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,238 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split. New replication is 10
2013-10-31 18:38:21,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=null
2013-10-31 18:38:21,246 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split. blk_8427397160063122151_1243
2013-10-31 18:38:21,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:47878 dest: /127.0.0.1:37740
2013-10-31 18:38:21,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:43988 dest: /127.0.0.1:59471
2013-10-31 18:38:21,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:50792 dest: /127.0.0.1:34578
2013-10-31 18:38:21,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:48164 dest: /127.0.0.1:54365
2013-10-31 18:38:21,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48164, dest: /127.0.0.1:54365, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8427397160063122151_1243, duration: 118693
2013-10-31 18:38:21,257 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50792, dest: /127.0.0.1:34578, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8427397160063122151_1243, duration: 969660
2013-10-31 18:38:21,258 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,258 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,258 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43988, dest: /127.0.0.1:59471, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8427397160063122151_1243, duration: 2103632
2013-10-31 18:38:21,259 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47878, dest: /127.0.0.1:37740, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8427397160063122151_1243, duration: 3042922
2013-10-31 18:38:21,260 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,262 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,263 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split from client DFSClient_-1596270109
2013-10-31 18:38:21,263 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split is closed by DFSClient_-1596270109
2013-10-31 18:38:21,264 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,264 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,280 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo. blk_6870044034096666232_1244
2013-10-31 18:38:21,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6870044034096666232_1244 src: /127.0.0.1:50794 dest: /127.0.0.1:34578
2013-10-31 18:38:21,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6870044034096666232_1244 src: /127.0.0.1:47883 dest: /127.0.0.1:37740
2013-10-31 18:38:21,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6870044034096666232_1244 src: /127.0.0.1:48167 dest: /127.0.0.1:54365
2013-10-31 18:38:21,288 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48167, dest: /127.0.0.1:54365, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6870044034096666232_1244, duration: 64190
2013-10-31 18:38:21,288 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6870044034096666232_1244 terminating
2013-10-31 18:38:21,288 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47883, dest: /127.0.0.1:37740, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6870044034096666232_1244, duration: 829293
2013-10-31 18:38:21,289 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6870044034096666232_1244 terminating
2013-10-31 18:38:21,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data2/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:21,289 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50794, dest: /127.0.0.1:34578, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6870044034096666232_1244, duration: 1767671
2013-10-31 18:38:21,289 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6870044034096666232_1244 size 148
2013-10-31 18:38:21,290 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6870044034096666232_1244 terminating
2013-10-31 18:38:21,292 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6870044034096666232_1244 size 148
2013-10-31 18:38:21,290 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data2/current/blk_-4526157860798952037
2013-10-31 18:38:21,292 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:38:21,289 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data1/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:21,293 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:38:21,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2296380649723109786_1235 file build/test/data/dfs/data/data1/current/blk_-2296380649723109786 for deletion
2013-10-31 18:38:21,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data1/current/blk_-4387391707925617419
2013-10-31 18:38:21,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2168431696822472542_1236 file build/test/data/dfs/data/data2/current/blk_2168431696822472542 for deletion
2013-10-31 18:38:21,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2296380649723109786_1235 at file build/test/data/dfs/data/data1/current/blk_-2296380649723109786
2013-10-31 18:38:21,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2168431696822472542_1236 at file build/test/data/dfs/data/data2/current/blk_2168431696822472542
2013-10-31 18:38:21,295 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6870044034096666232_1244 size 148
2013-10-31 18:38:21,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,317 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml. blk_-4581583629309912568_1245
2013-10-31 18:38:21,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4581583629309912568_1245 src: /127.0.0.1:48168 dest: /127.0.0.1:54365
2013-10-31 18:38:21,320 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4581583629309912568_1245 src: /127.0.0.1:43995 dest: /127.0.0.1:59471
2013-10-31 18:38:21,322 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4581583629309912568_1245 src: /127.0.0.1:47887 dest: /127.0.0.1:37740
2013-10-31 18:38:21,325 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47887, dest: /127.0.0.1:37740, bytes: 28616, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4581583629309912568_1245, duration: 336637
2013-10-31 18:38:21,325 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4581583629309912568_1245 terminating
2013-10-31 18:38:21,326 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43995, dest: /127.0.0.1:59471, bytes: 28616, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4581583629309912568_1245, duration: 1157743
2013-10-31 18:38:21,326 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4581583629309912568_1245 terminating
2013-10-31 18:38:21,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4581583629309912568_1245 size 28616
2013-10-31 18:38:21,327 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48168, dest: /127.0.0.1:54365, bytes: 28616, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4581583629309912568_1245, duration: 2100471
2013-10-31 18:38:21,327 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4581583629309912568_1245 terminating
2013-10-31 18:38:21,329 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml from client DFSClient_-1596270109
2013-10-31 18:38:21,329 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:38:21,330 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4581583629309912568_1245 size 28616
2013-10-31 18:38:21,331 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4581583629309912568_1245 size 28616
2013-10-31 18:38:21,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=null
2013-10-31 18:38:21,344 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48172, bytes: 28840, op: HDFS_READ, cliID: DFSClient_-922529183, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4581583629309912568_1245, duration: 397216
2013-10-31 18:38:21,362 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0024: nMaps=4 nReduces=1 max=-1
2013-10-31 18:38:21,363 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0024 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:38:21,363 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0024
2013-10-31 18:38:21,363 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0024	RESULT=SUCCESS
2013-10-31 18:38:21,363 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0024
2013-10-31 18:38:21,364 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] submitted hadoop job: job_20131031182606197_0024
2013-10-31 18:38:21,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data8/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:21,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data7/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:21,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data8/current/blk_-4526157860798952037
2013-10-31 18:38:21,384 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2296380649723109786_1235 file build/test/data/dfs/data/data7/current/blk_-2296380649723109786 for deletion
2013-10-31 18:38:21,384 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data7/current/blk_-4387391707925617419
2013-10-31 18:38:21,384 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2168431696822472542_1236 file build/test/data/dfs/data/data8/current/blk_2168431696822472542 for deletion
2013-10-31 18:38:21,384 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2296380649723109786_1235 at file build/test/data/dfs/data/data7/current/blk_-2296380649723109786
2013-10-31 18:38:21,384 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2168431696822472542_1236 at file build/test/data/dfs/data/data8/current/blk_2168431696822472542
2013-10-31 18:38:21,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,392 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml. blk_-5550225210473142444_1247
2013-10-31 18:38:21,393 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5550225210473142444_1247 src: /127.0.0.1:50802 dest: /127.0.0.1:34578
2013-10-31 18:38:21,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5550225210473142444_1247 src: /127.0.0.1:47891 dest: /127.0.0.1:37740
2013-10-31 18:38:21,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5550225210473142444_1247 src: /127.0.0.1:44001 dest: /127.0.0.1:59471
2013-10-31 18:38:21,399 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44001, dest: /127.0.0.1:59471, bytes: 28681, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5550225210473142444_1247, duration: 749234
2013-10-31 18:38:21,400 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5550225210473142444_1247 terminating
2013-10-31 18:38:21,400 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47891, dest: /127.0.0.1:37740, bytes: 28681, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5550225210473142444_1247, duration: 1092935
2013-10-31 18:38:21,400 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5550225210473142444_1247 terminating
2013-10-31 18:38:21,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50802, dest: /127.0.0.1:34578, bytes: 28681, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5550225210473142444_1247, duration: 1487835
2013-10-31 18:38:21,401 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5550225210473142444_1247 terminating
2013-10-31 18:38:21,403 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5550225210473142444_1247 size 28681
2013-10-31 18:38:21,403 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml from client DFSClient_-922529183
2013-10-31 18:38:21,403 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml is closed by DFSClient_-922529183
2013-10-31 18:38:21,403 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5550225210473142444_1247 size 28681
2013-10-31 18:38:21,404 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5550225210473142444_1247 size 28681
2013-10-31 18:38:21,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,551 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken. blk_2225977986120785000_1248
2013-10-31 18:38:21,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2225977986120785000_1248 src: /127.0.0.1:44002 dest: /127.0.0.1:59471
2013-10-31 18:38:21,554 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2225977986120785000_1248 src: /127.0.0.1:50806 dest: /127.0.0.1:34578
2013-10-31 18:38:21,556 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2225977986120785000_1248 src: /127.0.0.1:48178 dest: /127.0.0.1:54365
2013-10-31 18:38:21,559 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48178, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2225977986120785000_1248, duration: 88405
2013-10-31 18:38:21,559 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2225977986120785000_1248 terminating
2013-10-31 18:38:21,559 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50806, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 967024
2013-10-31 18:38:21,560 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2225977986120785000_1248 terminating
2013-10-31 18:38:21,560 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44002, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2225977986120785000_1248, duration: 1926862
2013-10-31 18:38:21,560 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2225977986120785000_1248 size 116
2013-10-31 18:38:21,561 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2225977986120785000_1248 terminating
2013-10-31 18:38:21,566 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2225977986120785000_1248 size 116
2013-10-31 18:38:21,566 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2225977986120785000_1248 size 116
2013-10-31 18:38:21,566 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken from client DFSClient_-1596270109
2013-10-31 18:38:21,567 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:38:21,571 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken
2013-10-31 18:38:21,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:38:21,575 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47896, bytes: 152, op: HDFS_READ, cliID: DFSClient_-922529183, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6870044034096666232_1244, duration: 280795
2013-10-31 18:38:21,576 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0024 = 140. Number of splits = 4
2013-10-31 18:38:21,577 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,577 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,577 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,577 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,580 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0024 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:38:21,580 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0024 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:38:22,503 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_5873056186943798323_1242 to datanode(s) 127.0.0.1:37740
2013-10-31 18:38:22,504 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_121557755361841184_1239
2013-10-31 18:38:22,504 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_121557755361841184_1239
2013-10-31 18:38:23,147 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_121557755361841184_1239 file build/test/data/dfs/data/data4/current/blk_121557755361841184 for deletion
2013-10-31 18:38:23,147 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_121557755361841184_1239 at file build/test/data/dfs/data/data4/current/blk_121557755361841184
2013-10-31 18:38:23,749 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0024_m_000005_0' to tip task_20131031182606197_0024_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:23,758 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:38:23,758 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000005_0 which needs 1 slots
2013-10-31 18:38:23,758 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000005_0 which needs 1 slots
2013-10-31 18:38:23,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken	dst=null	perm=null
2013-10-31 18:38:23,767 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48180, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2225977986120785000_1248, duration: 393090
2013-10-31 18:38:23,767 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 52 raw values into 1 aggregated values, total 2
2013-10-31 18:38:23,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=null
2013-10-31 18:38:23,777 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48182, bytes: 28840, op: HDFS_READ, cliID: DFSClient_-35211420, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4581583629309912568_1245, duration: 381481
2013-10-31 18:38:23,807 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:23,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=null
2013-10-31 18:38:23,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44009, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-35211420, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5873056186943798323_1242, duration: 1199742
2013-10-31 18:38:23,875 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_121557755361841184_1239 file build/test/data/dfs/data/data6/current/blk_121557755361841184 for deletion
2013-10-31 18:38:23,876 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_121557755361841184_1239 at file build/test/data/dfs/data/data6/current/blk_121557755361841184
2013-10-31 18:38:23,934 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0023_m_-959828638
2013-10-31 18:38:23,941 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29474 with signal TERM. Exit code 0
2013-10-31 18:38:23,941 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-278089939
2013-10-31 18:38:23,942 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-278089939 spawned.
2013-10-31 18:38:23,944 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000005_0/taskjvm.sh
2013-10-31 18:38:24,273 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_5873056186943798323_1242 to 127.0.0.1:37740 
2013-10-31 18:38:24,275 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:47901 dest: /127.0.0.1:37740
2013-10-31 18:38:24,275 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_5873056186943798323_1242 to /127.0.0.1:37740
2013-10-31 18:38:24,566 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5873056186943798323_1242 src: /127.0.0.1:47901 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:38:24,567 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:24,637 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:24,637 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:24,637 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:24,637 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_-959828638 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:25,369 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-278089939 given task: attempt_20131031182606197_0024_m_000005_0
2013-10-31 18:38:25,504 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_121557755361841184_1239
2013-10-31 18:38:25,745 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,745 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0023_m_000004_0 not found in cache
2013-10-31 18:38:25,746 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105746
2013-10-31 18:38:25,746 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,746 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105746
2013-10-31 18:38:25,747 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105747
2013-10-31 18:38:25,747 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,748 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105748
2013-10-31 18:38:25,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:26,758 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_r_-739234499 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:26,769 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29905 with signal TERM. Exit code 0
2013-10-31 18:38:26,942 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:26,942 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:26,942 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:26,942 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_r_-739234499 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:27,061 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_-806897 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,071 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29629 with signal TERM. Exit code 0
2013-10-31 18:38:27,203 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_525620828 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,213 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29698 with signal TERM. Exit code 0
2013-10-31 18:38:27,224 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_1805283263 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,235 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29704 with signal TERM. Exit code 0
2013-10-31 18:38:27,238 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_4777009 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,247 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29703 with signal TERM. Exit code 0
2013-10-31 18:38:27,255 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,255 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,255 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:27,255 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_-806897 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:38:27,346 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_121557755361841184_1239 file build/test/data/dfs/data/data8/current/blk_121557755361841184 for deletion
2013-10-31 18:38:27,347 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_121557755361841184_1239 at file build/test/data/dfs/data/data8/current/blk_121557755361841184
2013-10-31 18:38:27,423 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,424 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,424 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:27,424 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_525620828 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:27,440 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,441 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,441 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:27,441 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_1805283263 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:27,460 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,460 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,460 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:27,460 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_4777009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:28,839 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000005_0 0.0% setup
2013-10-31 18:38:28,844 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000005_0 is done.
2013-10-31 18:38:28,844 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000005_0  was -1
2013-10-31 18:38:28,845 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:29,811 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000005_0' has completed task_20131031182606197_0024_m_000005 successfully.
2013-10-31 18:38:29,814 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000000_0' to tip task_20131031182606197_0024_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:29,815 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000000
2013-10-31 18:38:29,817 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:38:29,817 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000000_0 which needs 1 slots
2013-10-31 18:38:29,817 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000000_0 which needs 1 slots
2013-10-31 18:38:29,851 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-829914259
2013-10-31 18:38:29,852 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-829914259 spawned.
2013-10-31 18:38:29,855 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000000_0/taskjvm.sh
2013-10-31 18:38:30,942 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-829914259 given task: attempt_20131031182606197_0024_m_000000_0
2013-10-31 18:38:31,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=null
2013-10-31 18:38:31,464 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50818, bytes: 1567, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8427397160063122151_1243, duration: 170879
2013-10-31 18:38:31,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	dst=null	perm=null
2013-10-31 18:38:31,764 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44016, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4840805767582090128_1240, duration: 1039473
2013-10-31 18:38:32,770 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000001_0' to tip task_20131031182606197_0024_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:38:32,771 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000001
2013-10-31 18:38:32,773 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:38:32,773 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000002_0' to tip task_20131031182606197_0024_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:38:32,773 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000001_0 which needs 1 slots
2013-10-31 18:38:32,774 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000002
2013-10-31 18:38:32,774 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000001_0 which needs 1 slots
2013-10-31 18:38:32,776 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:38:32,776 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000002_0 which needs 1 slots
2013-10-31 18:38:32,776 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000002_0 which needs 1 slots
2013-10-31 18:38:32,777 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000003_0' to tip task_20131031182606197_0024_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:38:32,777 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000003
2013-10-31 18:38:32,779 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:38:32,779 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000003_0 which needs 1 slots
2013-10-31 18:38:32,780 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000003_0 which needs 1 slots
2013-10-31 18:38:32,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken	dst=null	perm=null
2013-10-31 18:38:32,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken	dst=null	perm=null
2013-10-31 18:38:32,785 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50820, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 374755
2013-10-31 18:38:32,789 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50821, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 301900
2013-10-31 18:38:32,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=null
2013-10-31 18:38:32,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=null
2013-10-31 18:38:32,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47912, bytes: 28840, op: HDFS_READ, cliID: DFSClient_-1332272270, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4581583629309912568_1245, duration: 374948
2013-10-31 18:38:32,801 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44022, bytes: 28840, op: HDFS_READ, cliID: DFSClient_12452885, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4581583629309912568_1245, duration: 417796
2013-10-31 18:38:32,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken	dst=null	perm=null
2013-10-31 18:38:32,828 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50826, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 277044
2013-10-31 18:38:32,831 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:32,831 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:32,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml	dst=null	perm=null
2013-10-31 18:38:32,838 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47916, bytes: 28840, op: HDFS_READ, cliID: DFSClient_20886102, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4581583629309912568_1245, duration: 391532
2013-10-31 18:38:32,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=null
2013-10-31 18:38:32,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=null
2013-10-31 18:38:32,864 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48200, bytes: 239915, op: HDFS_READ, cliID: DFSClient_12452885, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5873056186943798323_1242, duration: 743607
2013-10-31 18:38:32,868 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44027, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1332272270, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5873056186943798323_1242, duration: 1350739
2013-10-31 18:38:32,869 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:32,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar	dst=null	perm=null
2013-10-31 18:38:32,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50831, bytes: 239915, op: HDFS_READ, cliID: DFSClient_20886102, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5873056186943798323_1242, duration: 593297
2013-10-31 18:38:32,915 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_1142792948
2013-10-31 18:38:32,916 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_1142792948 spawned.
2013-10-31 18:38:32,917 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000002_0/taskjvm.sh
2013-10-31 18:38:32,930 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-1073228223
2013-10-31 18:38:32,931 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-1073228223 spawned.
2013-10-31 18:38:32,932 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000001_0/taskjvm.sh
2013-10-31 18:38:32,944 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-1355604951
2013-10-31 18:38:32,945 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-1355604951 spawned.
2013-10-31 18:38:32,946 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000003_0/taskjvm.sh
2013-10-31 18:38:34,390 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:0+35
2013-10-31 18:38:34,392 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000000_0 is done.
2013-10-31 18:38:34,392 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000000_0  was 6
2013-10-31 18:38:34,392 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:34,556 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_1142792948 given task: attempt_20131031182606197_0024_m_000002_0
2013-10-31 18:38:34,648 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-1073228223 given task: attempt_20131031182606197_0024_m_000001_0
2013-10-31 18:38:34,673 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-1355604951 given task: attempt_20131031182606197_0024_m_000003_0
2013-10-31 18:38:34,817 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0024_m_000005_0
2013-10-31 18:38:34,818 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0024_m_000005_0
2013-10-31 18:38:34,818 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0024_m_000005_0 not found in cache
2013-10-31 18:38:35,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=null
2013-10-31 18:38:35,051 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44036, bytes: 1051, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8427397160063122151_1243, duration: 195981
2013-10-31 18:38:35,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	dst=null	perm=null
2013-10-31 18:38:35,090 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50841, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4840805767582090128_1240, duration: 138209
2013-10-31 18:38:35,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=null
2013-10-31 18:38:35,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47931, bytes: 1567, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8427397160063122151_1243, duration: 160168
2013-10-31 18:38:35,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	dst=null	perm=null
2013-10-31 18:38:35,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44041, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4840805767582090128_1240, duration: 108959
2013-10-31 18:38:35,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split	dst=null	perm=null
2013-10-31 18:38:35,201 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50845, bytes: 535, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8427397160063122151_1243, duration: 143643
2013-10-31 18:38:35,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	dst=null	perm=null
2013-10-31 18:38:35,240 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50846, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4840805767582090128_1240, duration: 133109
2013-10-31 18:38:35,823 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000000_0' has completed task_20131031182606197_0024_m_000000 successfully.
2013-10-31 18:38:35,825 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0024_r_000000_0' to tip task_20131031182606197_0024_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:35,828 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:38:35,828 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_r_000000_0 which needs 1 slots
2013-10-31 18:38:35,828 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_r_000000_0 which needs 1 slots
2013-10-31 18:38:35,866 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_r_-740270901
2013-10-31 18:38:35,867 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_r_-740270901 spawned.
2013-10-31 18:38:35,868 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_r_000000_0/taskjvm.sh
2013-10-31 18:38:36,755 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_r_-740270901 given task: attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:37,981 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:70+35
2013-10-31 18:38:37,984 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000002_0 is done.
2013-10-31 18:38:37,984 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000002_0  was 29
2013-10-31 18:38:37,985 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:38,076 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:35+35
2013-10-31 18:38:38,078 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000001_0 is done.
2013-10-31 18:38:38,079 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000001_0  was 6
2013-10-31 18:38:38,079 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:38,130 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:105+35
2013-10-31 18:38:38,132 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000003_0 is done.
2013-10-31 18:38:38,132 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000003_0  was 51
2013-10-31 18:38:38,132 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:38,780 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000001_0' has completed task_20131031182606197_0024_m_000001 successfully.
2013-10-31 18:38:38,783 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000002_0' has completed task_20131031182606197_0024_m_000002 successfully.
2013-10-31 18:38:38,785 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000003_0' has completed task_20131031182606197_0024_m_000003 successfully.
2013-10-31 18:38:42,430 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49885, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000000_0, duration: 8637538
2013-10-31 18:38:42,452 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44928, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000001_0, duration: 8544273
2013-10-31 18:38:42,466 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42253, bytes: 29, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000002_0, duration: 10321335
2013-10-31 18:38:42,483 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40233, bytes: 51, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000003_0, duration: 12445165
2013-10-31 18:38:43,232 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:43,273 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:43,323 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:43,531 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1304 Total time for transactions(ms): 28Number of transactions batched in Syncs: 120 Number of syncs: 905 SyncTimes(ms): 65667 14454 
2013-10-31 18:38:43,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:43,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:43,562 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000. blk_298656553194616881_1249
2013-10-31 18:38:43,598 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_298656553194616881_1249 src: /127.0.0.1:50854 dest: /127.0.0.1:34578
2013-10-31 18:38:43,599 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_298656553194616881_1249 src: /127.0.0.1:44052 dest: /127.0.0.1:59471
2013-10-31 18:38:43,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_298656553194616881_1249 src: /127.0.0.1:47944 dest: /127.0.0.1:37740
2013-10-31 18:38:43,603 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47944, dest: /127.0.0.1:37740, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0024_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 1518337
2013-10-31 18:38:43,604 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_298656553194616881_1249 terminating
2013-10-31 18:38:43,604 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44052, dest: /127.0.0.1:59471, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0024_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_298656553194616881_1249, duration: 2675780
2013-10-31 18:38:43,604 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_298656553194616881_1249 terminating
2013-10-31 18:38:43,604 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_298656553194616881_1249 size 41
2013-10-31 18:38:43,604 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50854, dest: /127.0.0.1:34578, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0024_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_298656553194616881_1249, duration: 3103341
2013-10-31 18:38:43,605 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_298656553194616881_1249 terminating
2013-10-31 18:38:43,607 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_298656553194616881_1249 size 41
2013-10-31 18:38:43,607 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:43,607 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:43,608 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_298656553194616881_1249 size 41
2013-10-31 18:38:43,642 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0024_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:38:43,643 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:44,836 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0024_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:38:44,838 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:45,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0	dst=null	perm=null
2013-10-31 18:38:45,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:45,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:45,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0	dst=null	perm=null
2013-10-31 18:38:46,286 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:46,288 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:46,289 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_r_000000_0 is done.
2013-10-31 18:38:46,290 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_r_000000_0  was -1
2013-10-31 18:38:46,290 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:47,841 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_r_000000_0' has completed task_20131031182606197_0024_r_000000 successfully.
2013-10-31 18:38:47,845 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0024_m_000004_0' to tip task_20131031182606197_0024_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:47,847 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:38:47,848 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000004_0 which needs 1 slots
2013-10-31 18:38:47,848 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000004_0 which needs 1 slots
2013-10-31 18:38:47,885 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0024/attempt_20131031182606197_0024_m_000004_0. Attempting to reuse: jvm_20131031182606197_0024_m_-278089939
2013-10-31 18:38:48,923 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-278089939 given task: attempt_20131031182606197_0024_m_000004_0
2013-10-31 18:38:49,031 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000004_0 0.0% 
2013-10-31 18:38:49,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary	dst=null	perm=null
2013-10-31 18:38:49,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:49,055 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_SUCCESS from client DFSClient_attempt_20131031182606197_0024_m_000004_0
2013-10-31 18:38:49,055 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0024_m_000004_0
2013-10-31 18:38:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,063 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6870044034096666232 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6870044034096666232 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6870044034096666232 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4581583629309912568 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:49,064 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4581583629309912568 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,065 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4581583629309912568 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024	dst=null	perm=null
2013-10-31 18:38:49,508 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_8427397160063122151_1243 blk_6870044034096666232_1244 blk_5873056186943798323_1242
2013-10-31 18:38:49,508 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_8427397160063122151_1243 blk_-4581583629309912568_1245 blk_5873056186943798323_1242
2013-10-31 18:38:50,884 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4581583629309912568_1245 file build/test/data/dfs/data/data6/current/blk_-4581583629309912568 for deletion
2013-10-31 18:38:50,885 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data6/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:50,885 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4581583629309912568_1245 at file build/test/data/dfs/data/data6/current/blk_-4581583629309912568
2013-10-31 18:38:50,885 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data5/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:50,885 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data6/current/blk_5873056186943798323
2013-10-31 18:38:50,886 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data5/current/blk_8427397160063122151
2013-10-31 18:38:51,282 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data2/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:51,282 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6870044034096666232_1244 file build/test/data/dfs/data/data2/current/blk_6870044034096666232 for deletion
2013-10-31 18:38:51,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data2/current/blk_5873056186943798323
2013-10-31 18:38:51,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data1/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:51,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6870044034096666232_1244 at file build/test/data/dfs/data/data2/current/blk_6870044034096666232
2013-10-31 18:38:51,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data1/current/blk_8427397160063122151
2013-10-31 18:38:52,002 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000004_0 0.0% cleanup
2013-10-31 18:38:52,004 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000004_0 is done.
2013-10-31 18:38:52,004 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000004_0  was -1
2013-10-31 18:38:52,004 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:52,509 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_8427397160063122151_1243 blk_6870044034096666232_1244 blk_-4581583629309912568_1245 blk_5873056186943798323_1242
2013-10-31 18:38:52,509 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_8427397160063122151_1243 blk_6870044034096666232_1244 blk_-4581583629309912568_1245 blk_5873056186943798323_1242
2013-10-31 18:38:52,848 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:52,848 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:53,157 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4581583629309912568_1245 file build/test/data/dfs/data/data4/current/blk_-4581583629309912568 for deletion
2013-10-31 18:38:53,157 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data3/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:53,157 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4581583629309912568_1245 at file build/test/data/dfs/data/data4/current/blk_-4581583629309912568
2013-10-31 18:38:53,157 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6870044034096666232_1244 file build/test/data/dfs/data/data3/current/blk_6870044034096666232 for deletion
2013-10-31 18:38:53,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data3/current/blk_5873056186943798323
2013-10-31 18:38:53,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data4/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:53,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6870044034096666232_1244 at file build/test/data/dfs/data/data3/current/blk_6870044034096666232
2013-10-31 18:38:53,159 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data4/current/blk_8427397160063122151
2013-10-31 18:38:53,854 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000004_0' has completed task_20131031182606197_0024_m_000004 successfully.
2013-10-31 18:38:53,855 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0024 has completed successfully.
2013-10-31 18:38:53,855 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0024,submitTime=1383244701334,launchTime=1383244701580,firstMapTaskLaunchTime=1383244709814,firstReduceTaskLaunchTime=1383244715825,firstJobSetupTaskLaunchTime=1383244703749,firstJobCleanupTaskLaunchTime=1383244727845,finishTime=1383244733855,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1C92A88E814146F3BAF77C456D0E6369/9C5FB226814F42F591262ADB67462D7D] third/(2/3) ...atform/chainedtaps/second
2013-10-31 18:38:53,860 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5. blk_-2768714479833497585_1250
2013-10-31 18:38:53,862 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2768714479833497585_1250 src: /127.0.0.1:50859 dest: /127.0.0.1:34578
2013-10-31 18:38:53,865 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2768714479833497585_1250 src: /127.0.0.1:44057 dest: /127.0.0.1:59471
2013-10-31 18:38:53,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2768714479833497585_1250 src: /127.0.0.1:48232 dest: /127.0.0.1:54365
2013-10-31 18:38:53,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48232, dest: /127.0.0.1:54365, bytes: 28080, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2768714479833497585_1250, duration: 5489475
2013-10-31 18:38:53,876 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2768714479833497585_1250 terminating
2013-10-31 18:38:53,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44057, dest: /127.0.0.1:59471, bytes: 28080, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2768714479833497585_1250, duration: 3594489
2013-10-31 18:38:53,877 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2768714479833497585_1250 terminating
2013-10-31 18:38:53,877 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50859, dest: /127.0.0.1:34578, bytes: 28080, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2768714479833497585_1250, duration: 5177988
2013-10-31 18:38:53,877 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2768714479833497585_1250 size 28080
2013-10-31 18:38:53,878 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2768714479833497585_1250 terminating
2013-10-31 18:38:53,880 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 from client DFSClient_-922529183
2013-10-31 18:38:53,880 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 is closed by DFSClient_-922529183
2013-10-31 18:38:53,881 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2768714479833497585_1250 size 28080
2013-10-31 18:38:53,881 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2768714479833497585_1250 size 28080
2013-10-31 18:38:53,886 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:53,886 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000000_0'
2013-10-31 18:38:53,887 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000004_0'
2013-10-31 18:38:53,887 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000005_0'
2013-10-31 18:38:53,887 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_r_000000_0'
2013-10-31 18:38:53,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2225977986120785000 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:53,888 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2225977986120785000 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:53,889 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2225977986120785000 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:53,892 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] starting step: (3/3) ...latform/chainedtaps/third
2013-10-31 18:38:53,892 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0024_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:53,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024	dst=null	perm=null
2013-10-31 18:38:53,899 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:38:53,899 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:38:53,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:53,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:38:53,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:53,921 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar. blk_-5088351345251133232_1251
2013-10-31 18:38:53,922 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:47951 dest: /127.0.0.1:37740
2013-10-31 18:38:53,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:50864 dest: /127.0.0.1:34578
2013-10-31 18:38:53,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:48236 dest: /127.0.0.1:54365
2013-10-31 18:38:53,942 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48236, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5088351345251133232_1251, duration: 6771556
2013-10-31 18:38:53,943 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5088351345251133232_1251 terminating
2013-10-31 18:38:53,943 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:53,943 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50864, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5088351345251133232_1251, duration: 7681197
2013-10-31 18:38:53,943 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:53,944 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5088351345251133232_1251 terminating
2013-10-31 18:38:53,944 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47951, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5088351345251133232_1251, duration: 8757559
2013-10-31 18:38:53,945 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5088351345251133232_1251 terminating
2013-10-31 18:38:53,946 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:53,946 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar from client DFSClient_-1596270109
2013-10-31 18:38:53,947 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:38:53,952 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar. New replication is 10
2013-10-31 18:38:53,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=null
2013-10-31 18:38:53,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:53,964 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:38:53,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second	dst=null	perm=null
2013-10-31 18:38:53,969 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:38:53,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:38:54,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,344 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split. New replication is 10
2013-10-31 18:38:54,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=null
2013-10-31 18:38:54,350 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split. blk_2159410241161564090_1252
2013-10-31 18:38:54,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:44063 dest: /127.0.0.1:59471
2013-10-31 18:38:54,353 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:48238 dest: /127.0.0.1:54365
2013-10-31 18:38:54,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:50868 dest: /127.0.0.1:34578
2013-10-31 18:38:54,355 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4581583629309912568_1245 file build/test/data/dfs/data/data7/current/blk_-4581583629309912568 for deletion
2013-10-31 18:38:54,356 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data7/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:54,356 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4581583629309912568_1245 at file build/test/data/dfs/data/data7/current/blk_-4581583629309912568
2013-10-31 18:38:54,356 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6870044034096666232_1244 file build/test/data/dfs/data/data8/current/blk_6870044034096666232 for deletion
2013-10-31 18:38:54,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data7/current/blk_5873056186943798323
2013-10-31 18:38:54,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data7/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:54,357 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:47957 dest: /127.0.0.1:37740
2013-10-31 18:38:54,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data7/current/blk_8427397160063122151
2013-10-31 18:38:54,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6870044034096666232_1244 at file build/test/data/dfs/data/data8/current/blk_6870044034096666232
2013-10-31 18:38:54,360 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47957, dest: /127.0.0.1:37740, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2159410241161564090_1252, duration: 84717
2013-10-31 18:38:54,361 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,361 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50868, dest: /127.0.0.1:34578, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2159410241161564090_1252, duration: 853762
2013-10-31 18:38:54,362 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,362 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48238, dest: /127.0.0.1:54365, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2159410241161564090_1252, duration: 1794434
2013-10-31 18:38:54,362 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,363 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,363 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44063, dest: /127.0.0.1:59471, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2159410241161564090_1252, duration: 2613244
2013-10-31 18:38:54,363 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,363 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,366 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,366 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split from client DFSClient_-1596270109
2013-10-31 18:38:54,367 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split is closed by DFSClient_-1596270109
2013-10-31 18:38:54,367 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,382 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo. blk_4561088021142520977_1253
2013-10-31 18:38:54,384 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4561088021142520977_1253 src: /127.0.0.1:48241 dest: /127.0.0.1:54365
2013-10-31 18:38:54,386 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4561088021142520977_1253 src: /127.0.0.1:47959 dest: /127.0.0.1:37740
2013-10-31 18:38:54,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4561088021142520977_1253 src: /127.0.0.1:50872 dest: /127.0.0.1:34578
2013-10-31 18:38:54,390 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50872, dest: /127.0.0.1:34578, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4561088021142520977_1253, duration: 68602
2013-10-31 18:38:54,390 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4561088021142520977_1253 terminating
2013-10-31 18:38:54,391 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47959, dest: /127.0.0.1:37740, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4561088021142520977_1253, duration: 831193
2013-10-31 18:38:54,391 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4561088021142520977_1253 terminating
2013-10-31 18:38:54,392 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48241, dest: /127.0.0.1:54365, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4561088021142520977_1253, duration: 1813672
2013-10-31 18:38:54,392 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4561088021142520977_1253 terminating
2013-10-31 18:38:54,394 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4561088021142520977_1253 size 148
2013-10-31 18:38:54,394 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:38:54,395 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:38:54,395 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4561088021142520977_1253 size 148
2013-10-31 18:38:54,396 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4561088021142520977_1253 size 148
2013-10-31 18:38:54,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,417 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml. blk_8650378453195215803_1254
2013-10-31 18:38:54,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8650378453195215803_1254 src: /127.0.0.1:50873 dest: /127.0.0.1:34578
2013-10-31 18:38:54,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8650378453195215803_1254 src: /127.0.0.1:44071 dest: /127.0.0.1:59471
2013-10-31 18:38:54,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8650378453195215803_1254 src: /127.0.0.1:47963 dest: /127.0.0.1:37740
2013-10-31 18:38:54,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47963, dest: /127.0.0.1:37740, bytes: 28684, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8650378453195215803_1254, duration: 95203
2013-10-31 18:38:54,425 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8650378453195215803_1254 terminating
2013-10-31 18:38:54,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44071, dest: /127.0.0.1:59471, bytes: 28684, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8650378453195215803_1254, duration: 910674
2013-10-31 18:38:54,426 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8650378453195215803_1254 terminating
2013-10-31 18:38:54,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50873, dest: /127.0.0.1:34578, bytes: 28684, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 1836208
2013-10-31 18:38:54,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8650378453195215803_1254 terminating
2013-10-31 18:38:54,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8650378453195215803_1254 size 28684
2013-10-31 18:38:54,431 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml from client DFSClient_-1596270109
2013-10-31 18:38:54,431 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:38:54,431 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8650378453195215803_1254 size 28684
2013-10-31 18:38:54,432 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8650378453195215803_1254 size 28684
2013-10-31 18:38:54,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=null
2013-10-31 18:38:54,447 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50877, bytes: 28912, op: HDFS_READ, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 389758
2013-10-31 18:38:54,465 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0025: nMaps=4 nReduces=1 max=-1
2013-10-31 18:38:54,466 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0025 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:38:54,466 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0025
2013-10-31 18:38:54,466 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0025	RESULT=SUCCESS
2013-10-31 18:38:54,466 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0025
2013-10-31 18:38:54,467 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] submitted hadoop job: job_20131031182606197_0025
2013-10-31 18:38:54,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,486 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml. blk_-2612740665432172558_1256
2013-10-31 18:38:54,487 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2612740665432172558_1256 src: /127.0.0.1:44075 dest: /127.0.0.1:59471
2013-10-31 18:38:54,488 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2612740665432172558_1256 src: /127.0.0.1:50879 dest: /127.0.0.1:34578
2013-10-31 18:38:54,489 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2612740665432172558_1256 src: /127.0.0.1:47968 dest: /127.0.0.1:37740
2013-10-31 18:38:54,492 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47968, dest: /127.0.0.1:37740, bytes: 28749, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2612740665432172558_1256, duration: 2029052
2013-10-31 18:38:54,492 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2612740665432172558_1256 terminating
2013-10-31 18:38:54,492 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50879, dest: /127.0.0.1:34578, bytes: 28749, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2612740665432172558_1256, duration: 1181641
2013-10-31 18:38:54,493 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2612740665432172558_1256 terminating
2013-10-31 18:38:54,493 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44075, dest: /127.0.0.1:59471, bytes: 28749, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2612740665432172558_1256, duration: 2595505
2013-10-31 18:38:54,493 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2612740665432172558_1256 terminating
2013-10-31 18:38:54,495 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2612740665432172558_1256 size 28749
2013-10-31 18:38:54,496 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2612740665432172558_1256 size 28749
2013-10-31 18:38:54,496 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2612740665432172558_1256 size 28749
2013-10-31 18:38:54,895 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml from client DFSClient_1105674743
2013-10-31 18:38:54,896 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml is closed by DFSClient_1105674743
2013-10-31 18:38:54,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,910 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken. blk_-3693249760350606050_1257
2013-10-31 18:38:54,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3693249760350606050_1257 src: /127.0.0.1:48253 dest: /127.0.0.1:54365
2013-10-31 18:38:54,914 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3693249760350606050_1257 src: /127.0.0.1:50883 dest: /127.0.0.1:34578
2013-10-31 18:38:54,916 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3693249760350606050_1257 src: /127.0.0.1:47972 dest: /127.0.0.1:37740
2013-10-31 18:38:54,919 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47972, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3693249760350606050_1257, duration: 69137
2013-10-31 18:38:54,919 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3693249760350606050_1257 terminating
2013-10-31 18:38:54,919 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50883, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3693249760350606050_1257, duration: 907968
2013-10-31 18:38:54,920 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3693249760350606050_1257 terminating
2013-10-31 18:38:54,920 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3693249760350606050_1257 size 116
2013-10-31 18:38:54,920 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48253, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3693249760350606050_1257, duration: 1930642
2013-10-31 18:38:54,921 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3693249760350606050_1257 terminating
2013-10-31 18:38:54,923 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3693249760350606050_1257 size 116
2013-10-31 18:38:54,924 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken from client DFSClient_-1596270109
2013-10-31 18:38:54,924 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:38:54,924 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3693249760350606050_1257 size 116
2013-10-31 18:38:54,929 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken
2013-10-31 18:38:54,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:38:54,934 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50885, bytes: 152, op: HDFS_READ, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4561088021142520977_1253, duration: 270403
2013-10-31 18:38:54,935 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0025 = 41. Number of splits = 4
2013-10-31 18:38:54,935 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,935 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,938 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,938 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0025 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:38:54,939 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0025 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:38:55,510 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-5088351345251133232_1251 to datanode(s) 127.0.0.1:59471
2013-10-31 18:38:55,510 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_2225977986120785000_1248
2013-10-31 18:38:55,511 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_2225977986120785000_1248
2013-10-31 18:38:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:38:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,030 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,051 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,051 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:38:56,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2225977986120785000_1248 file build/test/data/dfs/data/data3/current/blk_2225977986120785000 for deletion
2013-10-31 18:38:56,158 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2225977986120785000_1248 at file build/test/data/dfs/data/data3/current/blk_2225977986120785000
2013-10-31 18:38:56,804 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0025_m_000005_0' to tip task_20131031182606197_0025_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:38:56,809 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000001_0'
2013-10-31 18:38:56,811 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000002_0'
2013-10-31 18:38:56,812 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:38:56,812 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000005_0 which needs 1 slots
2013-10-31 18:38:56,813 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000003_0'
2013-10-31 18:38:56,813 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000005_0 which needs 1 slots
2013-10-31 18:38:56,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken	dst=null	perm=null
2013-10-31 18:38:56,822 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48257, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3693249760350606050_1257, duration: 301852
2013-10-31 18:38:56,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=null
2013-10-31 18:38:56,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44085, bytes: 28912, op: HDFS_READ, cliID: DFSClient_-878761968, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8650378453195215803_1254, duration: 382638
2013-10-31 18:38:56,858 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:56,888 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2225977986120785000_1248 file build/test/data/dfs/data/data6/current/blk_2225977986120785000 for deletion
2013-10-31 18:38:56,889 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2225977986120785000_1248 at file build/test/data/dfs/data/data6/current/blk_2225977986120785000
2013-10-31 18:38:56,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=null
2013-10-31 18:38:56,910 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50889, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-878761968, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5088351345251133232_1251, duration: 1453314
2013-10-31 18:38:57,007 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_892861919
2013-10-31 18:38:57,008 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_892861919 spawned.
2013-10-31 18:38:57,009 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000005_0/taskjvm.sh
2013-10-31 18:38:57,357 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-5088351345251133232_1251 to 127.0.0.1:59471 
2013-10-31 18:38:57,359 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:44087 dest: /127.0.0.1:59471
2013-10-31 18:38:57,359 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-5088351345251133232_1251 to /127.0.0.1:59471
2013-10-31 18:38:57,362 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5088351345251133232_1251 src: /127.0.0.1:44087 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:38:57,367 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:58,140 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_892861919 given task: attempt_20131031182606197_0025_m_000005_0
2013-10-31 18:38:58,511 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_2225977986120785000_1248
2013-10-31 18:38:58,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:58,889 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:38:58,889 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0024_m_000004_0 not found in cache
2013-10-31 18:38:58,889 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331138889
2013-10-31 18:38:58,955 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-829914259 since job job_20131031182606197_0024 is dead
2013-10-31 18:38:58,965 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30249 with signal TERM. Exit code 0
2013-10-31 18:38:59,166 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:59,166 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:59,166 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:38:59,166 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-829914259 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:00,041 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-278089939 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:00,049 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30109 with signal TERM. Exit code 0
2013-10-31 18:39:00,226 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:00,226 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:00,226 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:00,226 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-278089939 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:39:00,285 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2225977986120785000_1248 file build/test/data/dfs/data/data2/current/blk_2225977986120785000 for deletion
2013-10-31 18:39:00,285 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2225977986120785000_1248 at file build/test/data/dfs/data/data2/current/blk_2225977986120785000
2013-10-31 18:39:00,336 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_r_-740270901 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:00,346 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30534 with signal TERM. Exit code 0
2013-10-31 18:39:00,540 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:00,540 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:00,540 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:00,540 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_r_-740270901 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:01,556 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000005_0 0.0% setup
2013-10-31 18:39:01,559 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000005_0 is done.
2013-10-31 18:39:01,560 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000005_0  was -1
2013-10-31 18:39:01,560 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:01,813 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:39:01,813 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:39:01,813 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:39:01,814 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331141813
2013-10-31 18:39:01,814 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331141814
2013-10-31 18:39:01,814 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331141814
2013-10-31 18:39:02,567 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_1142792948 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:02,578 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30368 with signal TERM. Exit code 0
2013-10-31 18:39:02,660 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-1073228223 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:02,668 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30399 with signal TERM. Exit code 0
2013-10-31 18:39:02,711 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-1355604951 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:02,719 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30398 with signal TERM. Exit code 0
2013-10-31 18:39:02,791 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:02,791 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:02,791 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:02,791 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_1142792948 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:02,817 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000005_0' has completed task_20131031182606197_0025_m_000005 successfully.
2013-10-31 18:39:02,818 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000000_0' to tip task_20131031182606197_0025_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:02,819 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000000
2013-10-31 18:39:02,820 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:02,820 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000001_0' to tip task_20131031182606197_0025_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:39:02,820 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000000_0 which needs 1 slots
2013-10-31 18:39:02,820 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000000_0 which needs 1 slots
2013-10-31 18:39:02,820 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000001
2013-10-31 18:39:02,821 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000002_0' to tip task_20131031182606197_0025_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:02,821 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:39:02,821 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000002
2013-10-31 18:39:02,822 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000001_0 which needs 1 slots
2013-10-31 18:39:02,822 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000001_0 which needs 1 slots
2013-10-31 18:39:02,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken	dst=null	perm=null
2013-10-31 18:39:02,825 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50893, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3693249760350606050_1257, duration: 146653
2013-10-31 18:39:02,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=null
2013-10-31 18:39:02,830 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50895, bytes: 28912, op: HDFS_READ, cliID: DFSClient_-407238121, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 165253
2013-10-31 18:39:02,837 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_-1157186059
2013-10-31 18:39:02,837 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_-1157186059 spawned.
2013-10-31 18:39:02,838 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000000_0/taskjvm.sh
2013-10-31 18:39:02,859 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:39:02,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000002_0 which needs 1 slots
2013-10-31 18:39:02,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000002_0 which needs 1 slots
2013-10-31 18:39:02,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken	dst=null	perm=null
2013-10-31 18:39:02,863 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47984, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3693249760350606050_1257, duration: 134568
2013-10-31 18:39:02,864 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:02,864 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:02,865 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:02,865 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-1073228223 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:02,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=null
2013-10-31 18:39:02,868 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50898, bytes: 28912, op: HDFS_READ, cliID: DFSClient_-736367666, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 163575
2013-10-31 18:39:02,880 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:02,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=null
2013-10-31 18:39:02,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44096, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-736367666, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5088351345251133232_1251, duration: 600083
2013-10-31 18:39:02,898 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000003_0' to tip task_20131031182606197_0025_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:39:02,908 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:02,909 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:02,909 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:02,909 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-1355604951 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:02,975 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_-1449916997
2013-10-31 18:39:02,976 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_-1449916997 spawned.
2013-10-31 18:39:02,978 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000002_0/taskjvm.sh
2013-10-31 18:39:02,992 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000003
2013-10-31 18:39:02,994 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:39:02,994 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000003_0 which needs 1 slots
2013-10-31 18:39:02,994 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000003_0 which needs 1 slots
2013-10-31 18:39:02,996 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:02,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken	dst=null	perm=null
2013-10-31 18:39:03,003 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47988, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3693249760350606050_1257, duration: 420215
2013-10-31 18:39:03,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml	dst=null	perm=null
2013-10-31 18:39:03,013 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47990, bytes: 28912, op: HDFS_READ, cliID: DFSClient_196448053, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8650378453195215803_1254, duration: 450414
2013-10-31 18:39:03,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=null
2013-10-31 18:39:03,030 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44100, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-407238121, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5088351345251133232_1251, duration: 1257489
2013-10-31 18:39:03,039 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:03,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar	dst=null	perm=null
2013-10-31 18:39:03,064 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50904, bytes: 239915, op: HDFS_READ, cliID: DFSClient_196448053, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5088351345251133232_1251, duration: 1594693
2013-10-31 18:39:03,114 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_1489451507
2013-10-31 18:39:03,115 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_1489451507 spawned.
2013-10-31 18:39:03,117 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000001_0/taskjvm.sh
2013-10-31 18:39:03,134 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_1569445512
2013-10-31 18:39:03,135 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_1569445512 spawned.
2013-10-31 18:39:03,136 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000003_0/taskjvm.sh
2013-10-31 18:39:04,144 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_-1157186059 given task: attempt_20131031182606197_0025_m_000000_0
2013-10-31 18:39:04,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=null
2013-10-31 18:39:04,666 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47995, bytes: 1571, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2159410241161564090_1252, duration: 167399
2013-10-31 18:39:04,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:04,705 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44105, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_298656553194616881_1249, duration: 147099
2013-10-31 18:39:05,020 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_1569445512 given task: attempt_20131031182606197_0025_m_000003_0
2013-10-31 18:39:05,032 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_-1449916997 given task: attempt_20131031182606197_0025_m_000002_0
2013-10-31 18:39:05,043 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_1489451507 given task: attempt_20131031182606197_0025_m_000001_0
2013-10-31 18:39:07,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=null
2013-10-31 18:39:07,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44110, bytes: 1055, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2159410241161564090_1252, duration: 163716
2013-10-31 18:39:07,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:07,506 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48004, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 124728
2013-10-31 18:39:07,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=null
2013-10-31 18:39:07,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split	dst=null	perm=null
2013-10-31 18:39:07,574 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50917, bytes: 1571, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2159410241161564090_1252, duration: 169655
2013-10-31 18:39:07,578 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48289, bytes: 539, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2159410241161564090_1252, duration: 159870
2013-10-31 18:39:07,592 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000000_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:30+11
2013-10-31 18:39:07,593 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000000_0 is done.
2013-10-31 18:39:07,593 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000000_0  was 6
2013-10-31 18:39:07,593 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:07,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:07,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:07,617 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48007, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 123075
2013-10-31 18:39:07,820 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0025_m_000005_0
2013-10-31 18:39:07,820 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0025_m_000005_0
2013-10-31 18:39:07,820 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0025_m_000005_0 not found in cache
2013-10-31 18:39:07,865 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48008, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 134101
2013-10-31 18:39:08,826 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000000_0' has completed task_20131031182606197_0025_m_000000 successfully.
2013-10-31 18:39:08,827 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0025_r_000000_0' to tip task_20131031182606197_0025_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:08,829 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:08,830 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_r_000000_0 which needs 1 slots
2013-10-31 18:39:08,830 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_r_000000_0 which needs 1 slots
2013-10-31 18:39:08,866 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_r_723542760
2013-10-31 18:39:08,868 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_r_723542760 spawned.
2013-10-31 18:39:08,871 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_r_000000_0/taskjvm.sh
2013-10-31 18:39:09,740 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_r_723542760 given task: attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:10,396 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:10+10
2013-10-31 18:39:10,399 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000002_0 is done.
2013-10-31 18:39:10,399 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000002_0  was 28
2013-10-31 18:39:10,400 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:10,503 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:0+10
2013-10-31 18:39:10,505 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000001_0 is done.
2013-10-31 18:39:10,505 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000001_0  was 29
2013-10-31 18:39:10,505 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:10,506 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:20+10
2013-10-31 18:39:10,508 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000003_0 is done.
2013-10-31 18:39:10,508 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000003_0  was 29
2013-10-31 18:39:10,509 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:11,833 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000001_0' has completed task_20131031182606197_0025_m_000001 successfully.
2013-10-31 18:39:11,869 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000002_0' has completed task_20131031182606197_0025_m_000002 successfully.
2013-10-31 18:39:12,001 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000003_0' has completed task_20131031182606197_0025_m_000003 successfully.
2013-10-31 18:39:15,459 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45002, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000000_0, duration: 9798398
2013-10-31 18:39:15,486 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42327, bytes: 29, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000001_0, duration: 12329144
2013-10-31 18:39:15,503 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40307, bytes: 28, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000002_0, duration: 12109684
2013-10-31 18:39:15,522 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49963, bytes: 29, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000003_0, duration: 14208913
2013-10-31 18:39:16,254 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:16,297 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:16,358 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:16,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:16,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:16,586 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000. blk_466483600056883797_1258
2013-10-31 18:39:16,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_466483600056883797_1258 src: /127.0.0.1:48299 dest: /127.0.0.1:54365
2013-10-31 18:39:16,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_466483600056883797_1258 src: /127.0.0.1:50929 dest: /127.0.0.1:34578
2013-10-31 18:39:16,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_466483600056883797_1258 src: /127.0.0.1:48018 dest: /127.0.0.1:37740
2013-10-31 18:39:16,620 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48018, dest: /127.0.0.1:37740, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0025_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_466483600056883797_1258, duration: 1871360
2013-10-31 18:39:16,620 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_466483600056883797_1258 terminating
2013-10-31 18:39:16,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50929, dest: /127.0.0.1:34578, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0025_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_466483600056883797_1258, duration: 1953225
2013-10-31 18:39:16,621 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_466483600056883797_1258 terminating
2013-10-31 18:39:16,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48299, dest: /127.0.0.1:54365, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0025_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_466483600056883797_1258, duration: 2633004
2013-10-31 18:39:16,621 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_466483600056883797_1258 terminating
2013-10-31 18:39:16,624 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_466483600056883797_1258 size 41
2013-10-31 18:39:16,625 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_466483600056883797_1258 size 41
2013-10-31 18:39:16,625 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:16,625 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:16,626 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_466483600056883797_1258 size 41
2013-10-31 18:39:16,661 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0025_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:39:16,661 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:17,839 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0025_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:39:17,840 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:18,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0	dst=null	perm=null
2013-10-31 18:39:18,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:18,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:18,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0	dst=null	perm=null
2013-10-31 18:39:19,305 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:19,307 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:19,308 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_r_000000_0 is done.
2013-10-31 18:39:19,308 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_r_000000_0  was -1
2013-10-31 18:39:19,308 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:20,842 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_r_000000_0' has completed task_20131031182606197_0025_r_000000 successfully.
2013-10-31 18:39:20,845 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0025_m_000004_0' to tip task_20131031182606197_0025_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:20,847 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:39:20,847 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000004_0 which needs 1 slots
2013-10-31 18:39:20,847 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000004_0 which needs 1 slots
2013-10-31 18:39:20,876 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0025/attempt_20131031182606197_0025_m_000004_0. Attempting to reuse: jvm_20131031182606197_0025_m_-1157186059
2013-10-31 18:39:21,644 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_-1157186059 given task: attempt_20131031182606197_0025_m_000004_0
2013-10-31 18:39:21,771 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000004_0 0.0% 
2013-10-31 18:39:21,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary	dst=null	perm=null
2013-10-31 18:39:21,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:21,791 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_SUCCESS from client DFSClient_attempt_20131031182606197_0025_m_000004_0
2013-10-31 18:39:21,791 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0025_m_000004_0
2013-10-31 18:39:21,796 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:21,796 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4561088021142520977 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4561088021142520977 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4561088021142520977 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8650378453195215803 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8650378453195215803 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8650378453195215803 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025	dst=null	perm=null
2013-10-31 18:39:22,515 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_8650378453195215803_1254 blk_4561088021142520977_1253 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:22,515 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_8650378453195215803_1254 blk_4561088021142520977_1253 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:24,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data1/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:24,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data2/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:24,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4561088021142520977_1253 file build/test/data/dfs/data/data1/current/blk_4561088021142520977 for deletion
2013-10-31 18:39:24,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data1/current/blk_-5088351345251133232
2013-10-31 18:39:24,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8650378453195215803_1254 file build/test/data/dfs/data/data2/current/blk_8650378453195215803 for deletion
2013-10-31 18:39:24,294 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4561088021142520977_1253 at file build/test/data/dfs/data/data1/current/blk_4561088021142520977
2013-10-31 18:39:24,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data2/current/blk_2159410241161564090
2013-10-31 18:39:24,295 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8650378453195215803_1254 at file build/test/data/dfs/data/data2/current/blk_8650378453195215803
2013-10-31 18:39:24,366 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data7/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:24,366 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data8/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:24,366 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data7/current/blk_-5088351345251133232
2013-10-31 18:39:24,366 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4561088021142520977_1253 file build/test/data/dfs/data/data7/current/blk_4561088021142520977 for deletion
2013-10-31 18:39:24,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data8/current/blk_2159410241161564090
2013-10-31 18:39:24,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4561088021142520977_1253 at file build/test/data/dfs/data/data7/current/blk_4561088021142520977
2013-10-31 18:39:24,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8650378453195215803_1254 file build/test/data/dfs/data/data8/current/blk_8650378453195215803 for deletion
2013-10-31 18:39:24,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8650378453195215803_1254 at file build/test/data/dfs/data/data8/current/blk_8650378453195215803
2013-10-31 18:39:24,723 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000004_0 0.0% cleanup
2013-10-31 18:39:24,725 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000004_0 is done.
2013-10-31 18:39:24,725 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000004_0  was -1
2013-10-31 18:39:24,726 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:25,516 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_4561088021142520977_1253 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:25,516 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_8650378453195215803_1254 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:25,847 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:25,848 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:26,168 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data3/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:26,168 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data4/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:26,169 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data3/current/blk_-5088351345251133232
2013-10-31 18:39:26,169 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data4/current/blk_2159410241161564090
2013-10-31 18:39:26,169 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4561088021142520977_1253 file build/test/data/dfs/data/data3/current/blk_4561088021142520977 for deletion
2013-10-31 18:39:26,170 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4561088021142520977_1253 at file build/test/data/dfs/data/data3/current/blk_4561088021142520977
2013-10-31 18:39:26,854 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000004_0' has completed task_20131031182606197_0025_m_000004 successfully.
2013-10-31 18:39:26,855 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0025 has completed successfully.
2013-10-31 18:39:26,856 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0025,submitTime=1383244734438,launchTime=1383244734938,firstMapTaskLaunchTime=1383244742818,firstReduceTaskLaunchTime=1383244748827,firstJobSetupTaskLaunchTime=1383244736804,firstJobCleanupTaskLaunchTime=1383244760845,finishTime=1383244766855,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=35,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1C92A88E814146F3BAF77C456D0E6369/529FD0E8AF384BB88C36593F7D1DB660] third/(3/3) ...latform/chainedtaps/third
2013-10-31 18:39:26,861 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8. blk_-7258127012634329331_1259
2013-10-31 18:39:26,864 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7258127012634329331_1259 src: /127.0.0.1:48304 dest: /127.0.0.1:54365
2013-10-31 18:39:26,867 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7258127012634329331_1259 src: /127.0.0.1:44131 dest: /127.0.0.1:59471
2013-10-31 18:39:26,869 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7258127012634329331_1259 src: /127.0.0.1:50935 dest: /127.0.0.1:34578
2013-10-31 18:39:26,874 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50935, dest: /127.0.0.1:34578, bytes: 27977, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7258127012634329331_1259, duration: 3011882
2013-10-31 18:39:26,875 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7258127012634329331_1259 terminating
2013-10-31 18:39:26,875 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44131, dest: /127.0.0.1:59471, bytes: 27977, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7258127012634329331_1259, duration: 3903516
2013-10-31 18:39:26,876 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7258127012634329331_1259 terminating
2013-10-31 18:39:26,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48304, dest: /127.0.0.1:54365, bytes: 27977, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7258127012634329331_1259, duration: 4815169
2013-10-31 18:39:26,877 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7258127012634329331_1259 terminating
2013-10-31 18:39:26,879 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7258127012634329331_1259 size 27977
2013-10-31 18:39:26,879 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 from client DFSClient_1105674743
2013-10-31 18:39:26,880 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 is closed by DFSClient_1105674743
2013-10-31 18:39:26,880 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7258127012634329331_1259 size 27977
2013-10-31 18:39:26,881 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7258127012634329331_1259 size 27977
2013-10-31 18:39:26,890 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:39:26,891 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000000_0'
2013-10-31 18:39:26,891 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000004_0'
2013-10-31 18:39:26,891 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000005_0'
2013-10-31 18:39:26,891 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_r_000000_0'
2013-10-31 18:39:26,893 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3693249760350606050 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:26,893 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000002_0'
2013-10-31 18:39:26,893 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3693249760350606050 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:26,893 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3693249760350606050 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:26,894 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000001_0'
2013-10-31 18:39:26,896 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data6/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:26,897 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0025_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:39:26,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data5/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:26,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data6/current/blk_-5088351345251133232
2013-10-31 18:39:26,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8650378453195215803_1254 file build/test/data/dfs/data/data6/current/blk_8650378453195215803 for deletion
2013-10-31 18:39:26,897 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data5/current/blk_2159410241161564090
2013-10-31 18:39:26,898 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8650378453195215803_1254 at file build/test/data/dfs/data/data6/current/blk_8650378453195215803
2013-10-31 18:39:26,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025	dst=null	perm=null
2013-10-31 18:39:26,900 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary
2013-10-31 18:39:26,902 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary
2013-10-31 18:39:26,904 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary
2013-10-31 18:39:26,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second	dst=null	perm=null
2013-10-31 18:39:26,924 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:39:26,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:26,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:26,929 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48025, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 290396
2013-10-31 18:39:26,929 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chainedtaps/first
2013-10-31 18:39:26,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first	dst=null	perm=null
2013-10-31 18:39:26,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000	dst=null	perm=null
2013-10-31 18:39:26,935 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chainedtaps/third
2013-10-31 18:39:26,935 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48026, bytes: 144, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4840805767582090128_1240, duration: 264960
2013-10-31 18:39:26,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third	dst=null	perm=null
2013-10-31 18:39:26,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/part-00000	dst=null	perm=null
2013-10-31 18:39:26,940 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chainedtaps/second
2013-10-31 18:39:26,940 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48027, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_466483600056883797_1258, duration: 265496
2013-10-31 18:39:26,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second	dst=null	perm=null
2013-10-31 18:39:26,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000	dst=null	perm=null
2013-10-31 18:39:26,946 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48028, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 262402
2013-10-31 18:39:26,966 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:39:26,967 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:39:26,985 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:39:26,985 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:39:26,985 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall"]
2013-10-31 18:39:26,986 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:39:26,986 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 2
2013-10-31 18:39:26,986 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 2
2013-10-31 18:39:26,988 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/2)
2013-10-31 18:39:26,991 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:39:26,991 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:39:26,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:27,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:39:27,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,018 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000003_0'
2013-10-31 18:39:27,018 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar. blk_5732320106450968581_1260
2013-10-31 18:39:27,020 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:50941 dest: /127.0.0.1:34578
2013-10-31 18:39:27,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:44139 dest: /127.0.0.1:59471
2013-10-31 18:39:27,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:48314 dest: /127.0.0.1:54365
2013-10-31 18:39:27,030 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48314, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5732320106450968581_1260, duration: 3833520
2013-10-31 18:39:27,031 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5732320106450968581_1260 terminating
2013-10-31 18:39:27,031 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44139, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5732320106450968581_1260, duration: 5087788
2013-10-31 18:39:27,032 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5732320106450968581_1260 terminating
2013-10-31 18:39:27,032 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50941, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5732320106450968581_1260, duration: 5674449
2013-10-31 18:39:27,033 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5732320106450968581_1260 terminating
2013-10-31 18:39:27,034 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:27,034 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar from client DFSClient_-1596270109
2013-10-31 18:39:27,035 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:39:27,035 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:27,036 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:27,040 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar. New replication is 10
2013-10-31 18:39:27,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=null
2013-10-31 18:39:27,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,051 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:39:27,055 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:39:27,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:39:27,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,422 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split. New replication is 10
2013-10-31 18:39:27,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=null
2013-10-31 18:39:27,429 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split. blk_6176005180406254197_1261
2013-10-31 18:39:27,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:50944 dest: /127.0.0.1:34578
2013-10-31 18:39:27,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:44142 dest: /127.0.0.1:59471
2013-10-31 18:39:27,434 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:48317 dest: /127.0.0.1:54365
2013-10-31 18:39:27,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:48035 dest: /127.0.0.1:37740
2013-10-31 18:39:27,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48035, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6176005180406254197_1261, duration: 170832
2013-10-31 18:39:27,439 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48317, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6176005180406254197_1261, duration: 1000532
2013-10-31 18:39:27,440 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,440 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,441 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44142, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6176005180406254197_1261, duration: 1971317
2013-10-31 18:39:27,441 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,441 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,441 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50944, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 2872192
2013-10-31 18:39:27,442 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,442 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,445 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,445 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split from client DFSClient_-1596270109
2013-10-31 18:39:27,446 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split is closed by DFSClient_-1596270109
2013-10-31 18:39:27,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,465 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo. blk_9032010287967684730_1262
2013-10-31 18:39:27,467 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9032010287967684730_1262 src: /127.0.0.1:48036 dest: /127.0.0.1:37740
2013-10-31 18:39:27,468 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9032010287967684730_1262 src: /127.0.0.1:44146 dest: /127.0.0.1:59471
2013-10-31 18:39:27,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9032010287967684730_1262 src: /127.0.0.1:48321 dest: /127.0.0.1:54365
2013-10-31 18:39:27,473 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48321, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9032010287967684730_1262, duration: 66740
2013-10-31 18:39:27,473 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9032010287967684730_1262 terminating
2013-10-31 18:39:27,474 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44146, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9032010287967684730_1262, duration: 868297
2013-10-31 18:39:27,474 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9032010287967684730_1262 terminating
2013-10-31 18:39:27,475 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9032010287967684730_1262 size 156
2013-10-31 18:39:27,475 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48036, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9032010287967684730_1262, duration: 1678699
2013-10-31 18:39:27,475 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9032010287967684730_1262 terminating
2013-10-31 18:39:27,475 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9032010287967684730_1262 size 156
2013-10-31 18:39:27,480 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9032010287967684730_1262 size 156
2013-10-31 18:39:27,480 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:39:27,480 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:39:27,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,512 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml. blk_-4906023149535420440_1263
2013-10-31 18:39:27,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4906023149535420440_1263 src: /127.0.0.1:48039 dest: /127.0.0.1:37740
2013-10-31 18:39:27,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4906023149535420440_1263 src: /127.0.0.1:48323 dest: /127.0.0.1:54365
2013-10-31 18:39:27,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4906023149535420440_1263 src: /127.0.0.1:50953 dest: /127.0.0.1:34578
2013-10-31 18:39:27,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50953, dest: /127.0.0.1:34578, bytes: 28417, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 336563
2013-10-31 18:39:27,520 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4906023149535420440_1263 terminating
2013-10-31 18:39:27,520 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4906023149535420440_1263 size 28417
2013-10-31 18:39:27,521 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48323, dest: /127.0.0.1:54365, bytes: 28417, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4906023149535420440_1263, duration: 1186542
2013-10-31 18:39:27,521 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4906023149535420440_1263 terminating
2013-10-31 18:39:27,522 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48039, dest: /127.0.0.1:37740, bytes: 28417, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4906023149535420440_1263, duration: 2160995
2013-10-31 18:39:27,522 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4906023149535420440_1263 terminating
2013-10-31 18:39:27,524 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml from client DFSClient_-1596270109
2013-10-31 18:39:27,524 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:39:27,525 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4906023149535420440_1263 size 28417
2013-10-31 18:39:27,526 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4906023149535420440_1263 size 28417
2013-10-31 18:39:27,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=null
2013-10-31 18:39:27,539 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50955, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1039012288, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 486699
2013-10-31 18:39:27,558 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0026: nMaps=4 nReduces=1 max=-1
2013-10-31 18:39:27,558 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0026 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:39:27,558 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0026
2013-10-31 18:39:27,558 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0026	RESULT=SUCCESS
2013-10-31 18:39:27,559 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0026
2013-10-31 18:39:27,560 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0026
2013-10-31 18:39:27,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,591 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml. blk_-6217975784485380900_1265
2013-10-31 18:39:27,593 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6217975784485380900_1265 src: /127.0.0.1:48044 dest: /127.0.0.1:37740
2013-10-31 18:39:27,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6217975784485380900_1265 src: /127.0.0.1:48328 dest: /127.0.0.1:54365
2013-10-31 18:39:27,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6217975784485380900_1265 src: /127.0.0.1:44155 dest: /127.0.0.1:59471
2013-10-31 18:39:27,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44155, dest: /127.0.0.1:59471, bytes: 28482, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6217975784485380900_1265, duration: 363247
2013-10-31 18:39:27,601 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6217975784485380900_1265 terminating
2013-10-31 18:39:27,601 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48328, dest: /127.0.0.1:54365, bytes: 28482, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6217975784485380900_1265, duration: 1775394
2013-10-31 18:39:27,601 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6217975784485380900_1265 terminating
2013-10-31 18:39:27,602 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48044, dest: /127.0.0.1:37740, bytes: 28482, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6217975784485380900_1265, duration: 2061867
2013-10-31 18:39:27,603 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6217975784485380900_1265 terminating
2013-10-31 18:39:27,604 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6217975784485380900_1265 size 28482
2013-10-31 18:39:27,604 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml from client DFSClient_1039012288
2013-10-31 18:39:27,605 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml is closed by DFSClient_1039012288
2013-10-31 18:39:27,605 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6217975784485380900_1265 size 28482
2013-10-31 18:39:27,606 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6217975784485380900_1265 size 28482
2013-10-31 18:39:27,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,618 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken. blk_-1528558439058240571_1266
2013-10-31 18:39:27,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1528558439058240571_1266 src: /127.0.0.1:44156 dest: /127.0.0.1:59471
2013-10-31 18:39:27,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1528558439058240571_1266 src: /127.0.0.1:50960 dest: /127.0.0.1:34578
2013-10-31 18:39:27,622 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1528558439058240571_1266 src: /127.0.0.1:48049 dest: /127.0.0.1:37740
2013-10-31 18:39:27,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48049, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1528558439058240571_1266, duration: 65888
2013-10-31 18:39:27,626 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1528558439058240571_1266 terminating
2013-10-31 18:39:27,626 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1528558439058240571_1266 size 116
2013-10-31 18:39:27,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50960, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 940021
2013-10-31 18:39:27,627 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1528558439058240571_1266 terminating
2013-10-31 18:39:27,627 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44156, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1528558439058240571_1266, duration: 1923655
2013-10-31 18:39:27,628 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1528558439058240571_1266 terminating
2013-10-31 18:39:27,633 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken from client DFSClient_-1596270109
2013-10-31 18:39:27,634 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:39:27,634 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1528558439058240571_1266 size 116
2013-10-31 18:39:27,635 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1528558439058240571_1266 size 116
2013-10-31 18:39:27,641 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken
2013-10-31 18:39:27,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:39:27,645 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44159, bytes: 160, op: HDFS_READ, cliID: DFSClient_1039012288, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9032010287967684730_1262, duration: 277147
2013-10-31 18:39:27,646 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0026 = 1449. Number of splits = 4
2013-10-31 18:39:27,646 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0026 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:39:27,650 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0026 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:39:28,268 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3135295757712174631_1031
2013-10-31 18:39:28,517 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_5732320106450968581_1260 to datanode(s) 127.0.0.1:37740
2013-10-31 18:39:28,517 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-3693249760350606050_1257
2013-10-31 18:39:28,517 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-3693249760350606050_1257
2013-10-31 18:39:29,169 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3693249760350606050_1257 file build/test/data/dfs/data/data4/current/blk_-3693249760350606050 for deletion
2013-10-31 18:39:29,169 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3693249760350606050_1257 at file build/test/data/dfs/data/data4/current/blk_-3693249760350606050
2013-10-31 18:39:29,897 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0026_m_000005_0' to tip task_20131031182606197_0026_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:29,901 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_5732320106450968581_1260 to 127.0.0.1:37740 
2013-10-31 18:39:29,906 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:39:29,906 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000005_0 which needs 1 slots
2013-10-31 18:39:29,907 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000005_0 which needs 1 slots
2013-10-31 18:39:29,907 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:48051 dest: /127.0.0.1:37740
2013-10-31 18:39:29,907 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_5732320106450968581_1260 to /127.0.0.1:37740
2013-10-31 18:39:29,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5732320106450968581_1260 src: /127.0.0.1:48051 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:39:29,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken	dst=null	perm=null
2013-10-31 18:39:29,914 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:29,915 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50964, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 267473
2013-10-31 18:39:29,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=null
2013-10-31 18:39:29,925 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50966, bytes: 28641, op: HDFS_READ, cliID: DFSClient_323030406, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 375981
2013-10-31 18:39:29,955 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:29,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=null
2013-10-31 18:39:29,980 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48055, bytes: 239915, op: HDFS_READ, cliID: DFSClient_323030406, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5732320106450968581_1260, duration: 1187561
2013-10-31 18:39:30,073 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_1759873103
2013-10-31 18:39:30,074 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_1759873103 spawned.
2013-10-31 18:39:30,075 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000005_0/taskjvm.sh
2013-10-31 18:39:30,295 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3693249760350606050_1257 file build/test/data/dfs/data/data2/current/blk_-3693249760350606050 for deletion
2013-10-31 18:39:30,295 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3693249760350606050_1257 at file build/test/data/dfs/data/data2/current/blk_-3693249760350606050
2013-10-31 18:39:31,439 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_1759873103 given task: attempt_20131031182606197_0026_m_000005_0
2013-10-31 18:39:31,518 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-3693249760350606050_1257
2013-10-31 18:39:31,893 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:31,893 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0025_m_000004_0 not found in cache
2013-10-31 18:39:31,894 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:31,894 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331171894
2013-10-31 18:39:31,894 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331171894
2013-10-31 18:39:31,895 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:31,895 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331171895
2013-10-31 18:39:31,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:31,962 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_-1449916997 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:31,970 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30996 with signal TERM. Exit code 0
2013-10-31 18:39:32,018 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:32,019 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331172019
2013-10-31 18:39:32,065 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_1489451507 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,069 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30995 with signal TERM. Exit code 0
2013-10-31 18:39:32,069 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_1569445512 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,076 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30994 with signal TERM. Exit code 0
2013-10-31 18:39:32,146 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_892861919 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,151 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30741 with signal TERM. Exit code 0
2013-10-31 18:39:32,159 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,159 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,159 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:32,159 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_-1449916997 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,270 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,270 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,270 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:32,270 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_1489451507 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,271 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,271 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,271 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:32,271 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_1569445512 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,305 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,305 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,305 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:32,305 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_892861919 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,764 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_-1157186059 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,774 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30954 with signal TERM. Exit code 0
2013-10-31 18:39:32,955 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,955 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,955 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:32,955 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_-1157186059 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:39:33,348 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_r_723542760 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:33,358 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31184 with signal TERM. Exit code 0
2013-10-31 18:39:33,369 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3693249760350606050_1257 file build/test/data/dfs/data/data8/current/blk_-3693249760350606050 for deletion
2013-10-31 18:39:33,369 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3693249760350606050_1257 at file build/test/data/dfs/data/data8/current/blk_-3693249760350606050
2013-10-31 18:39:33,530 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:33,530 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:33,530 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:39:33,530 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_r_723542760 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:34,888 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000005_0 0.0% setup
2013-10-31 18:39:34,891 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000005_0 is done.
2013-10-31 18:39:34,891 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000005_0  was -1
2013-10-31 18:39:34,891 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:35,913 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000005_0' has completed task_20131031182606197_0026_m_000005 successfully.
2013-10-31 18:39:35,916 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000000_0' to tip task_20131031182606197_0026_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:35,917 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000000
2013-10-31 18:39:35,919 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:35,919 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000001_0' to tip task_20131031182606197_0026_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:35,919 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000000_0 which needs 1 slots
2013-10-31 18:39:35,920 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000000_0 which needs 1 slots
2013-10-31 18:39:35,920 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000001
2013-10-31 18:39:35,923 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:39:35,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000001_0 which needs 1 slots
2013-10-31 18:39:35,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000001_0 which needs 1 slots
2013-10-31 18:39:35,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken	dst=null	perm=null
2013-10-31 18:39:35,932 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48064, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1528558439058240571_1266, duration: 294516
2013-10-31 18:39:35,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=null
2013-10-31 18:39:35,942 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48349, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1958758557, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4906023149535420440_1263, duration: 392327
2013-10-31 18:39:35,949 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000002_0' to tip task_20131031182606197_0026_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:39:35,949 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000002
2013-10-31 18:39:35,951 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:39:35,951 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000002_0 which needs 1 slots
2013-10-31 18:39:35,951 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000002_0 which needs 1 slots
2013-10-31 18:39:35,953 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_-367135844
2013-10-31 18:39:35,954 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_-367135844 spawned.
2013-10-31 18:39:35,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken	dst=null	perm=null
2013-10-31 18:39:35,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50979, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 152617
2013-10-31 18:39:35,959 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000000_0/taskjvm.sh
2013-10-31 18:39:35,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=null
2013-10-31 18:39:35,966 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:35,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50981, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1820528008, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 407528
2013-10-31 18:39:35,980 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:35,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=null
2013-10-31 18:39:35,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50982, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1958758557, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5732320106450968581_1260, duration: 1397924
2013-10-31 18:39:35,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=null
2013-10-31 18:39:35,994 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48071, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1820528008, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5732320106450968581_1260, duration: 613521
2013-10-31 18:39:36,025 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000003_0' to tip task_20131031182606197_0026_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:39:36,025 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000003
2013-10-31 18:39:36,026 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:39:36,026 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000003_0 which needs 1 slots
2013-10-31 18:39:36,027 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000003_0 which needs 1 slots
2013-10-31 18:39:36,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken	dst=null	perm=null
2013-10-31 18:39:36,033 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50984, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 152579
2013-10-31 18:39:36,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml	dst=null	perm=null
2013-10-31 18:39:36,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48357, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1063817356, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4906023149535420440_1263, duration: 201686
2013-10-31 18:39:36,071 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_-182868421
2013-10-31 18:39:36,071 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_-182868421 spawned.
2013-10-31 18:39:36,073 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000002_0/taskjvm.sh
2013-10-31 18:39:36,091 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_-1931337023
2013-10-31 18:39:36,092 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_-1931337023 spawned.
2013-10-31 18:39:36,093 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000001_0/taskjvm.sh
2013-10-31 18:39:36,227 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:36,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar	dst=null	perm=null
2013-10-31 18:39:36,257 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48358, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1063817356, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5732320106450968581_1260, duration: 1181248
2013-10-31 18:39:37,032 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_1455195278
2013-10-31 18:39:37,033 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_1455195278 spawned.
2013-10-31 18:39:37,034 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000003_0/taskjvm.sh
2013-10-31 18:39:37,955 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_-182868421 given task: attempt_20131031182606197_0026_m_000002_0
2013-10-31 18:39:37,996 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_-1931337023 given task: attempt_20131031182606197_0026_m_000001_0
2013-10-31 18:39:38,012 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_-367135844 given task: attempt_20131031182606197_0026_m_000000_0
2013-10-31 18:39:38,079 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_1455195278 given task: attempt_20131031182606197_0026_m_000003_0
2013-10-31 18:39:38,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=null
2013-10-31 18:39:38,465 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50995, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 167534
2013-10-31 18:39:38,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=null
2013-10-31 18:39:38,500 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44193, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6176005180406254197_1261, duration: 160542
2013-10-31 18:39:38,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:39:38,504 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48085, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 147628
2013-10-31 18:39:38,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=null
2013-10-31 18:39:38,536 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50999, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 159242
2013-10-31 18:39:38,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:39:38,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:39:38,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51000, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 155657
2013-10-31 18:39:38,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split	dst=null	perm=null
2013-10-31 18:39:38,616 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51001, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 150721
2013-10-31 18:39:38,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:39:38,655 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51002, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 168292
2013-10-31 18:39:38,794 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51003, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 167938
2013-10-31 18:39:40,920 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0026_m_000005_0
2013-10-31 18:39:40,920 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0026_m_000005_0
2013-10-31 18:39:40,920 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0026_m_000005_0 not found in cache
2013-10-31 18:39:41,010 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 45
2013-10-31 18:39:41,393 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:39:41,396 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000002_0 is done.
2013-10-31 18:39:41,396 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000002_0  was 6
2013-10-31 18:39:41,396 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,429 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:39:41,431 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000001_0 is done.
2013-10-31 18:39:41,431 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000001_0  was 6
2013-10-31 18:39:41,431 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,461 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:39:41,462 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000000_0 is done.
2013-10-31 18:39:41,462 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000000_0  was 6
2013-10-31 18:39:41,462 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,541 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:39:41,544 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000003_0 is done.
2013-10-31 18:39:41,544 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000003_0  was 6
2013-10-31 18:39:41,544 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,924 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000000_0' has completed task_20131031182606197_0026_m_000000 successfully.
2013-10-31 18:39:42,549 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0026_r_000000_0' to tip task_20131031182606197_0026_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:42,550 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000003_0' has completed task_20131031182606197_0026_m_000003 successfully.
2013-10-31 18:39:42,552 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:42,552 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_r_000000_0 which needs 1 slots
2013-10-31 18:39:42,552 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_r_000000_0 which needs 1 slots
2013-10-31 18:39:42,553 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000002_0' has completed task_20131031182606197_0026_m_000002 successfully.
2013-10-31 18:39:42,556 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000001_0' has completed task_20131031182606197_0026_m_000001 successfully.
2013-10-31 18:39:42,600 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_r_519201635
2013-10-31 18:39:42,601 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_r_519201635 spawned.
2013-10-31 18:39:42,603 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_r_000000_0/taskjvm.sh
2013-10-31 18:39:43,428 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_r_519201635 given task: attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:49,125 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40388, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000000_0, duration: 6298378
2013-10-31 18:39:49,143 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50044, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000003_0, duration: 6565707
2013-10-31 18:39:49,159 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42411, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000002_0, duration: 13115422
2013-10-31 18:39:49,176 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45088, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000001_0, duration: 12105968
2013-10-31 18:39:49,920 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:49,991 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:50,044 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:50,247 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1396 Total time for transactions(ms): 30Number of transactions batched in Syncs: 124 Number of syncs: 971 SyncTimes(ms): 66709 14626 
2013-10-31 18:39:50,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:50,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:50,269 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000. blk_-1380093626912959803_1267
2013-10-31 18:39:50,291 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1380093626912959803_1267 src: /127.0.0.1:48099 dest: /127.0.0.1:37740
2013-10-31 18:39:50,292 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1380093626912959803_1267 src: /127.0.0.1:48383 dest: /127.0.0.1:54365
2013-10-31 18:39:50,293 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1380093626912959803_1267 src: /127.0.0.1:44210 dest: /127.0.0.1:59471
2013-10-31 18:39:50,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44210, dest: /127.0.0.1:59471, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0026_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1380093626912959803_1267, duration: 1020773
2013-10-31 18:39:50,295 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1380093626912959803_1267 terminating
2013-10-31 18:39:50,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48383, dest: /127.0.0.1:54365, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0026_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1380093626912959803_1267, duration: 1405525
2013-10-31 18:39:50,295 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1380093626912959803_1267 terminating
2013-10-31 18:39:50,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48099, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0026_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1380093626912959803_1267, duration: 1792389
2013-10-31 18:39:50,296 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1380093626912959803_1267 terminating
2013-10-31 18:39:50,299 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1380093626912959803_1267 size 70
2013-10-31 18:39:50,299 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1380093626912959803_1267 size 70
2013-10-31 18:39:50,299 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:50,300 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:50,300 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1380093626912959803_1267 size 70
2013-10-31 18:39:51,561 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0026_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:39:51,627 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0026_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:39:51,627 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:52,967 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:54,566 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:54,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0	dst=null	perm=null
2013-10-31 18:39:54,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:54,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:54,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0	dst=null	perm=null
2013-10-31 18:39:55,999 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:39:56,005 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,007 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:56,009 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:56,009 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_r_000000_0 is done.
2013-10-31 18:39:56,009 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_r_000000_0  was -1
2013-10-31 18:39:56,010 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:56,011 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,032 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:39:57,570 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_r_000000_0' has completed task_20131031182606197_0026_r_000000 successfully.
2013-10-31 18:39:57,573 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0026_m_000004_0' to tip task_20131031182606197_0026_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:57,576 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:39:57,576 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000004_0 which needs 1 slots
2013-10-31 18:39:57,576 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000004_0 which needs 1 slots
2013-10-31 18:39:57,611 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0026/attempt_20131031182606197_0026_m_000004_0. Attempting to reuse: jvm_20131031182606197_0026_m_1759873103
2013-10-31 18:39:57,974 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_1759873103 given task: attempt_20131031182606197_0026_m_000004_0
2013-10-31 18:39:58,091 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000004_0 0.0% 
2013-10-31 18:39:58,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary	dst=null	perm=null
2013-10-31 18:39:58,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:58,116 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_SUCCESS from client DFSClient_attempt_20131031182606197_0026_m_000004_0
2013-10-31 18:39:58,116 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0026_m_000004_0
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:58,121 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9032010287967684730 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9032010287967684730 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:58,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9032010287967684730 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4906023149535420440 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:58,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4906023149535420440 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,122 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4906023149535420440 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026	dst=null	perm=null
2013-10-31 18:39:58,522 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_5732320106450968581_1260 blk_6176005180406254197_1261 blk_-4906023149535420440_1263
2013-10-31 18:39:58,523 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_9032010287967684730_1262 blk_5732320106450968581_1260 blk_6176005180406254197_1261 blk_-4906023149535420440_1263
2013-10-31 18:39:59,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4906023149535420440_1263 file build/test/data/dfs/data/data4/current/blk_-4906023149535420440 for deletion
2013-10-31 18:39:59,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data3/current/blk_5732320106450968581 for deletion
2013-10-31 18:39:59,179 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4906023149535420440_1263 at file build/test/data/dfs/data/data4/current/blk_-4906023149535420440
2013-10-31 18:39:59,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data4/current/blk_6176005180406254197 for deletion
2013-10-31 18:39:59,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data3/current/blk_5732320106450968581
2013-10-31 18:39:59,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data4/current/blk_6176005180406254197
2013-10-31 18:39:59,180 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9032010287967684730_1262 file build/test/data/dfs/data/data3/current/blk_9032010287967684730 for deletion
2013-10-31 18:39:59,181 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9032010287967684730_1262 at file build/test/data/dfs/data/data3/current/blk_9032010287967684730
2013-10-31 18:40:00,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4906023149535420440_1263 file build/test/data/dfs/data/data1/current/blk_-4906023149535420440 for deletion
2013-10-31 18:40:00,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data1/current/blk_5732320106450968581 for deletion
2013-10-31 18:40:00,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4906023149535420440_1263 at file build/test/data/dfs/data/data1/current/blk_-4906023149535420440
2013-10-31 18:40:00,305 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data2/current/blk_6176005180406254197 for deletion
2013-10-31 18:40:00,306 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data1/current/blk_5732320106450968581
2013-10-31 18:40:00,306 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data2/current/blk_6176005180406254197
2013-10-31 18:40:01,060 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000004_0 0.0% cleanup
2013-10-31 18:40:01,061 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000004_0 is done.
2013-10-31 18:40:01,062 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000004_0  was -1
2013-10-31 18:40:01,062 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:01,523 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_9032010287967684730_1262 blk_5732320106450968581_1260 blk_6176005180406254197_1261 blk_-4906023149535420440_1263
2013-10-31 18:40:01,523 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_9032010287967684730_1262 blk_5732320106450968581_1260 blk_6176005180406254197_1261
2013-10-31 18:40:02,576 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:40:02,577 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:40:02,909 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data6/current/blk_5732320106450968581 for deletion
2013-10-31 18:40:02,909 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data5/current/blk_6176005180406254197 for deletion
2013-10-31 18:40:02,909 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data6/current/blk_5732320106450968581
2013-10-31 18:40:02,909 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data5/current/blk_6176005180406254197
2013-10-31 18:40:02,909 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9032010287967684730_1262 file build/test/data/dfs/data/data6/current/blk_9032010287967684730 for deletion
2013-10-31 18:40:02,910 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9032010287967684730_1262 at file build/test/data/dfs/data/data6/current/blk_9032010287967684730
2013-10-31 18:40:03,379 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4906023149535420440_1263 file build/test/data/dfs/data/data8/current/blk_-4906023149535420440 for deletion
2013-10-31 18:40:03,379 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data7/current/blk_5732320106450968581 for deletion
2013-10-31 18:40:03,379 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4906023149535420440_1263 at file build/test/data/dfs/data/data8/current/blk_-4906023149535420440
2013-10-31 18:40:03,379 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data8/current/blk_6176005180406254197 for deletion
2013-10-31 18:40:03,380 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data7/current/blk_5732320106450968581
2013-10-31 18:40:03,380 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9032010287967684730_1262 file build/test/data/dfs/data/data7/current/blk_9032010287967684730 for deletion
2013-10-31 18:40:03,380 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data8/current/blk_6176005180406254197
2013-10-31 18:40:03,380 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9032010287967684730_1262 at file build/test/data/dfs/data/data7/current/blk_9032010287967684730
2013-10-31 18:40:03,584 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000004_0' has completed task_20131031182606197_0026_m_000004 successfully.
2013-10-31 18:40:03,585 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0026 has completed successfully.
2013-10-31 18:40:03,585 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0026,submitTime=1383244767530,launchTime=1383244767649,firstMapTaskLaunchTime=1383244775915,firstReduceTaskLaunchTime=1383244782549,firstJobSetupTaskLaunchTime=1383244769897,firstJobCleanupTaskLaunchTime=1383244797573,finishTime=1383244803585,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=13,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FAAB6EBD019249188EA583AD21382B9F/D90437FD803C40DABA4DA224C6E69B82] test/(1/2)
2013-10-31 18:40:03,590 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA. blk_6068750247121428629_1268
2013-10-31 18:40:03,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6068750247121428629_1268 src: /127.0.0.1:48388 dest: /127.0.0.1:54365
2013-10-31 18:40:03,594 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6068750247121428629_1268 src: /127.0.0.1:51018 dest: /127.0.0.1:34578
2013-10-31 18:40:03,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6068750247121428629_1268 src: /127.0.0.1:44216 dest: /127.0.0.1:59471
2013-10-31 18:40:03,606 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44216, dest: /127.0.0.1:59471, bytes: 26184, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6068750247121428629_1268, duration: 6103471
2013-10-31 18:40:03,607 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6068750247121428629_1268 terminating
2013-10-31 18:40:03,607 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51018, dest: /127.0.0.1:34578, bytes: 26184, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6068750247121428629_1268, duration: 3981101
2013-10-31 18:40:03,608 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6068750247121428629_1268 terminating
2013-10-31 18:40:03,608 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6068750247121428629_1268 size 26184
2013-10-31 18:40:03,608 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48388, dest: /127.0.0.1:54365, bytes: 26184, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6068750247121428629_1268, duration: 3213688
2013-10-31 18:40:03,609 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6068750247121428629_1268 terminating
2013-10-31 18:40:03,609 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6068750247121428629_1268 size 26184
2013-10-31 18:40:03,612 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA from client DFSClient_1039012288
2013-10-31 18:40:03,612 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA is closed by DFSClient_1039012288
2013-10-31 18:40:03,613 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6068750247121428629_1268 size 26184
2013-10-31 18:40:03,622 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:03,623 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000000_0'
2013-10-31 18:40:03,623 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000004_0'
2013-10-31 18:40:03,623 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000005_0'
2013-10-31 18:40:03,623 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_r_000000_0'
2013-10-31 18:40:03,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1528558439058240571 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:03,625 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000001_0'
2013-10-31 18:40:03,625 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1528558439058240571 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:03,626 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1528558439058240571 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:03,626 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000002_0'
2013-10-31 18:40:03,628 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0026_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:03,630 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (2/2) ...edpipesplatform/filterall
2013-10-31 18:40:03,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026	dst=null	perm=null
2013-10-31 18:40:03,636 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:40:03,636 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:40:03,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:03,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:40:03,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,668 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar. blk_6192954468864407371_1269
2013-10-31 18:40:03,670 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:51021 dest: /127.0.0.1:34578
2013-10-31 18:40:03,671 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:44219 dest: /127.0.0.1:59471
2013-10-31 18:40:03,677 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:48394 dest: /127.0.0.1:54365
2013-10-31 18:40:03,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48394, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6192954468864407371_1269, duration: 7524087
2013-10-31 18:40:03,688 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6192954468864407371_1269 terminating
2013-10-31 18:40:03,688 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44219, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6192954468864407371_1269, duration: 8672118
2013-10-31 18:40:03,689 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6192954468864407371_1269 terminating
2013-10-31 18:40:03,689 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51021, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6192954468864407371_1269, duration: 9250837
2013-10-31 18:40:03,690 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6192954468864407371_1269 terminating
2013-10-31 18:40:03,692 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:03,692 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar from client DFSClient_-1596270109
2013-10-31 18:40:03,692 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:40:03,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:03,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:03,698 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar. New replication is 10
2013-10-31 18:40:03,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar	dst=null	perm=null
2013-10-31 18:40:03,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,711 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:40:03,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6	dst=null	perm=null
2013-10-31 18:40:03,717 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:40:03,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000	dst=null	perm=null
2013-10-31 18:40:03,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,733 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split. New replication is 10
2013-10-31 18:40:03,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split	dst=null	perm=null
2013-10-31 18:40:03,740 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split. blk_-3080819444042136648_1270
2013-10-31 18:40:03,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:48395 dest: /127.0.0.1:54365
2013-10-31 18:40:03,744 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:44222 dest: /127.0.0.1:59471
2013-10-31 18:40:03,745 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:51026 dest: /127.0.0.1:34578
2013-10-31 18:40:03,747 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:48115 dest: /127.0.0.1:37740
2013-10-31 18:40:03,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48115, dest: /127.0.0.1:37740, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3080819444042136648_1270, duration: 68117
2013-10-31 18:40:03,751 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51026, dest: /127.0.0.1:34578, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3080819444042136648_1270, duration: 905215
2013-10-31 18:40:03,752 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,752 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,752 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44222, dest: /127.0.0.1:59471, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3080819444042136648_1270, duration: 1844485
2013-10-31 18:40:03,753 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,753 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48395, dest: /127.0.0.1:54365, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3080819444042136648_1270, duration: 2840182
2013-10-31 18:40:03,754 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,754 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,758 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,759 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split from client DFSClient_-1596270109
2013-10-31 18:40:03,759 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split is closed by DFSClient_-1596270109
2013-10-31 18:40:03,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,782 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo. blk_2526140641696613949_1271
2013-10-31 18:40:03,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2526140641696613949_1271 src: /127.0.0.1:48399 dest: /127.0.0.1:54365
2013-10-31 18:40:03,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2526140641696613949_1271 src: /127.0.0.1:44226 dest: /127.0.0.1:59471
2013-10-31 18:40:03,787 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2526140641696613949_1271 src: /127.0.0.1:48118 dest: /127.0.0.1:37740
2013-10-31 18:40:03,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48118, dest: /127.0.0.1:37740, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2526140641696613949_1271, duration: 64946
2013-10-31 18:40:03,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2526140641696613949_1271 terminating
2013-10-31 18:40:03,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44226, dest: /127.0.0.1:59471, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2526140641696613949_1271, duration: 878256
2013-10-31 18:40:03,791 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2526140641696613949_1271 size 43
2013-10-31 18:40:03,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2526140641696613949_1271 terminating
2013-10-31 18:40:03,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48399, dest: /127.0.0.1:54365, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2526140641696613949_1271, duration: 1956745
2013-10-31 18:40:03,792 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2526140641696613949_1271 terminating
2013-10-31 18:40:03,792 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2526140641696613949_1271 size 43
2013-10-31 18:40:03,794 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:40:03,794 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:40:03,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2526140641696613949_1271 size 43
2013-10-31 18:40:04,524 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_6192954468864407371_1269 to datanode(s) 127.0.0.1:37740
2013-10-31 18:40:04,525 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-1528558439058240571_1266
2013-10-31 18:40:04,525 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-1528558439058240571_1266
2013-10-31 18:40:04,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,739 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml. blk_6254397619874930752_1272
2013-10-31 18:40:04,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6254397619874930752_1272 src: /127.0.0.1:51031 dest: /127.0.0.1:34578
2013-10-31 18:40:04,743 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6254397619874930752_1272 src: /127.0.0.1:48120 dest: /127.0.0.1:37740
2013-10-31 18:40:04,745 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6254397619874930752_1272 src: /127.0.0.1:48404 dest: /127.0.0.1:54365
2013-10-31 18:40:04,748 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48404, dest: /127.0.0.1:54365, bytes: 28632, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6254397619874930752_1272, duration: 280141
2013-10-31 18:40:04,749 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6254397619874930752_1272 terminating
2013-10-31 18:40:04,749 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48120, dest: /127.0.0.1:37740, bytes: 28632, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6254397619874930752_1272, duration: 1148620
2013-10-31 18:40:04,750 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6254397619874930752_1272 terminating
2013-10-31 18:40:04,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51031, dest: /127.0.0.1:34578, bytes: 28632, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6254397619874930752_1272, duration: 2203859
2013-10-31 18:40:04,751 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6254397619874930752_1272 terminating
2013-10-31 18:40:04,752 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6254397619874930752_1272 size 28632
2013-10-31 18:40:04,753 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml from client DFSClient_-1596270109
2013-10-31 18:40:04,754 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:40:04,754 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6254397619874930752_1272 size 28632
2013-10-31 18:40:04,755 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6254397619874930752_1272 size 28632
2013-10-31 18:40:04,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml	dst=null	perm=null
2013-10-31 18:40:04,770 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48406, bytes: 28856, op: HDFS_READ, cliID: DFSClient_-856516835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6254397619874930752_1272, duration: 404077
2013-10-31 18:40:04,788 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0027: nMaps=1 nReduces=1 max=-1
2013-10-31 18:40:04,788 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0027 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:40:04,788 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0027	RESULT=SUCCESS
2013-10-31 18:40:04,788 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0027
2013-10-31 18:40:04,789 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0027
2013-10-31 18:40:04,789 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0027
2013-10-31 18:40:04,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,818 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml. blk_305302745974780331_1274
2013-10-31 18:40:04,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_305302745974780331_1274 src: /127.0.0.1:51036 dest: /127.0.0.1:34578
2013-10-31 18:40:04,821 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_305302745974780331_1274 src: /127.0.0.1:44234 dest: /127.0.0.1:59471
2013-10-31 18:40:04,823 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_305302745974780331_1274 src: /127.0.0.1:48126 dest: /127.0.0.1:37740
2013-10-31 18:40:04,827 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48126, dest: /127.0.0.1:37740, bytes: 28697, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_305302745974780331_1274, duration: 339927
2013-10-31 18:40:04,827 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_305302745974780331_1274 terminating
2013-10-31 18:40:04,827 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44234, dest: /127.0.0.1:59471, bytes: 28697, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_305302745974780331_1274, duration: 1334418
2013-10-31 18:40:04,828 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_305302745974780331_1274 terminating
2013-10-31 18:40:04,828 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51036, dest: /127.0.0.1:34578, bytes: 28697, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_305302745974780331_1274, duration: 2180716
2013-10-31 18:40:04,829 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_305302745974780331_1274 terminating
2013-10-31 18:40:04,831 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_305302745974780331_1274 size 28697
2013-10-31 18:40:04,831 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml from client DFSClient_-856516835
2013-10-31 18:40:04,831 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml is closed by DFSClient_-856516835
2013-10-31 18:40:04,832 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_305302745974780331_1274 size 28697
2013-10-31 18:40:04,833 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_305302745974780331_1274 size 28697
2013-10-31 18:40:04,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,847 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken. blk_-4765952773309717476_1275
2013-10-31 18:40:04,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4765952773309717476_1275 src: /127.0.0.1:48410 dest: /127.0.0.1:54365
2013-10-31 18:40:04,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4765952773309717476_1275 src: /127.0.0.1:44237 dest: /127.0.0.1:59471
2013-10-31 18:40:04,852 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4765952773309717476_1275 src: /127.0.0.1:51041 dest: /127.0.0.1:34578
2013-10-31 18:40:04,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51041, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4765952773309717476_1275, duration: 67059
2013-10-31 18:40:04,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4765952773309717476_1275 terminating
2013-10-31 18:40:04,855 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4765952773309717476_1275 size 116
2013-10-31 18:40:04,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44237, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4765952773309717476_1275, duration: 950958
2013-10-31 18:40:04,856 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4765952773309717476_1275 terminating
2013-10-31 18:40:04,856 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48410, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4765952773309717476_1275, duration: 1795885
2013-10-31 18:40:04,857 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4765952773309717476_1275 terminating
2013-10-31 18:40:04,861 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4765952773309717476_1275 size 116
2013-10-31 18:40:04,862 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken from client DFSClient_-1596270109
2013-10-31 18:40:04,862 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:40:04,863 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4765952773309717476_1275 size 116
2013-10-31 18:40:04,868 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken
2013-10-31 18:40:04,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:40:04,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48413, bytes: 47, op: HDFS_READ, cliID: DFSClient_-856516835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2526140641696613949_1271, duration: 275308
2013-10-31 18:40:04,872 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0027 = 70. Number of splits = 1
2013-10-31 18:40:04,872 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:04,873 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:04,873 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:04,873 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0027 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:40:04,874 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0027 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 18:40:05,910 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_6192954468864407371_1269 to 127.0.0.1:37740 
2013-10-31 18:40:05,910 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1528558439058240571_1266 file build/test/data/dfs/data/data6/current/blk_-1528558439058240571 for deletion
2013-10-31 18:40:05,911 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1528558439058240571_1266 at file build/test/data/dfs/data/data6/current/blk_-1528558439058240571
2013-10-31 18:40:05,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:48131 dest: /127.0.0.1:37740
2013-10-31 18:40:05,912 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_6192954468864407371_1269 to /127.0.0.1:37740
2013-10-31 18:40:05,915 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6192954468864407371_1269 src: /127.0.0.1:48131 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:40:05,916 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:06,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1528558439058240571_1266 file build/test/data/dfs/data/data2/current/blk_-1528558439058240571 for deletion
2013-10-31 18:40:06,307 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1528558439058240571_1266 at file build/test/data/dfs/data/data2/current/blk_-1528558439058240571
2013-10-31 18:40:06,585 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0027_m_000002_0' to tip task_20131031182606197_0027_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:06,588 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000003_0'
2013-10-31 18:40:06,589 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:40:06,589 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_m_000002_0 which needs 1 slots
2013-10-31 18:40:06,589 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_m_000002_0 which needs 1 slots
2013-10-31 18:40:06,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken	dst=null	perm=null
2013-10-31 18:40:06,595 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44241, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4765952773309717476_1275, duration: 309037
2013-10-31 18:40:06,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml	dst=null	perm=null
2013-10-31 18:40:06,601 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48134, bytes: 28856, op: HDFS_READ, cliID: DFSClient_-221887911, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6254397619874930752_1272, duration: 380009
2013-10-31 18:40:06,619 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:06,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar	dst=null	perm=null
2013-10-31 18:40:06,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51047, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-221887911, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6192954468864407371_1269, duration: 834652
2013-10-31 18:40:06,728 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0027_m_1741630968
2013-10-31 18:40:06,728 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0027_m_1741630968 spawned.
2013-10-31 18:40:06,730 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0027/attempt_20131031182606197_0027_m_000002_0/taskjvm.sh
2013-10-31 18:40:07,526 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-1528558439058240571_1266
2013-10-31 18:40:08,625 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:08,626 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0026_m_000004_0 not found in cache
2013-10-31 18:40:08,627 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331208626
2013-10-31 18:40:08,663 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:08,663 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:08,664 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331208664
2013-10-31 18:40:08,664 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331208664
2013-10-31 18:40:08,983 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_-182868421 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:08,994 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31615 with signal TERM. Exit code 0
2013-10-31 18:40:09,004 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_-1931337023 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:09,016 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31616 with signal TERM. Exit code 0
2013-10-31 18:40:09,034 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_-367135844 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:09,044 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31614 with signal TERM. Exit code 0
2013-10-31 18:40:09,091 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_1759873103 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:09,096 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31399 with signal TERM. Exit code 0
2013-10-31 18:40:09,234 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,234 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,234 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:09,234 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_-182868421 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:09,234 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,234 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,234 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:09,235 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_-1931337023 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:09,240 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,240 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,240 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:09,241 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_-367135844 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:09,252 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,252 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,252 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:09,252 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_1759873103 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:40:09,380 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1528558439058240571_1266 file build/test/data/dfs/data/data8/current/blk_-1528558439058240571 for deletion
2013-10-31 18:40:09,380 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1528558439058240571_1266 at file build/test/data/dfs/data/data8/current/blk_-1528558439058240571
2013-10-31 18:40:10,005 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_m_1741630968 given task: attempt_20131031182606197_0027_m_000002_0
2013-10-31 18:40:10,056 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_r_519201635 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:10,060 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31854 with signal TERM. Exit code 0
2013-10-31 18:40:10,220 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:10,220 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:10,220 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:10,221 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_r_519201635 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:10,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:11,589 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:11,590 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331211590
2013-10-31 18:40:12,134 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_1455195278 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:12,144 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31719 with signal TERM. Exit code 0
2013-10-31 18:40:12,392 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:12,392 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:12,393 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:12,393 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_1455195278 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:13,455 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000002_0 0.0% setup
2013-10-31 18:40:13,458 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_m_000002_0 is done.
2013-10-31 18:40:13,459 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_m_000002_0  was -1
2013-10-31 18:40:13,459 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:15,596 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_m_000002_0' has completed task_20131031182606197_0027_m_000002 successfully.
2013-10-31 18:40:15,599 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0027_m_000000_0' to tip task_20131031182606197_0027_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:15,601 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0027_m_000000
2013-10-31 18:40:15,602 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:40:15,603 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_m_000000_0 which needs 1 slots
2013-10-31 18:40:15,603 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_m_000000_0 which needs 1 slots
2013-10-31 18:40:15,635 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0027_m_1809268964
2013-10-31 18:40:15,635 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0027_m_1809268964 spawned.
2013-10-31 18:40:15,637 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0027/attempt_20131031182606197_0027_m_000000_0/taskjvm.sh
2013-10-31 18:40:16,500 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_m_1809268964 given task: attempt_20131031182606197_0027_m_000000_0
2013-10-31 18:40:17,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split	dst=null	perm=null
2013-10-31 18:40:17,017 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48424, bytes: 355, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0027_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3080819444042136648_1270, duration: 128239
2013-10-31 18:40:17,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000	dst=null	perm=null
2013-10-31 18:40:17,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48142, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0027_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1380093626912959803_1267, duration: 284926
2013-10-31 18:40:19,948 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000000_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000:0+70
2013-10-31 18:40:19,950 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_m_000000_0 is done.
2013-10-31 18:40:19,951 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_m_000000_0  was 6
2013-10-31 18:40:19,951 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:20,603 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0027_m_000002_0
2013-10-31 18:40:20,603 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0027_m_000002_0
2013-10-31 18:40:20,604 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0027_m_000002_0 not found in cache
2013-10-31 18:40:21,609 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_m_000000_0' has completed task_20131031182606197_0027_m_000000 successfully.
2013-10-31 18:40:21,739 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0027_r_000000_0' to tip task_20131031182606197_0027_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:21,742 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:40:21,743 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_r_000000_0 which needs 1 slots
2013-10-31 18:40:21,743 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_r_000000_0 which needs 1 slots
2013-10-31 18:40:21,775 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0027_r_95840884
2013-10-31 18:40:21,776 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0027_r_95840884 spawned.
2013-10-31 18:40:21,778 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0027/attempt_20131031182606197_0027_r_000000_0/taskjvm.sh
2013-10-31 18:40:22,593 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_r_95840884 given task: attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:28,283 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50093, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0027_m_000000_0, duration: 6880766
2013-10-31 18:40:29,110 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:29,156 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:29,206 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:29,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:29,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:29,427 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:29,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:29,467 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0027_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:29,468 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:30,752 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0027_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:40:30,753 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:31,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0	dst=null	perm=null
2013-10-31 18:40:31,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:31,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:31,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0	dst=null	perm=null
2013-10-31 18:40:32,151 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 1.0% reduce > reduce
2013-10-31 18:40:32,153 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 1.0% reduce > reduce
2013-10-31 18:40:32,154 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_r_000000_0 is done.
2013-10-31 18:40:32,154 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_r_000000_0  was -1
2013-10-31 18:40:32,154 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:33,757 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_r_000000_0' has completed task_20131031182606197_0027_r_000000 successfully.
2013-10-31 18:40:33,761 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0027_m_000001_0' to tip task_20131031182606197_0027_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:33,763 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:40:33,763 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_m_000001_0 which needs 1 slots
2013-10-31 18:40:33,763 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_m_000001_0 which needs 1 slots
2013-10-31 18:40:33,796 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0027/attempt_20131031182606197_0027_m_000001_0. Attempting to reuse: jvm_20131031182606197_0027_m_1809268964
2013-10-31 18:40:34,020 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_m_1809268964 given task: attempt_20131031182606197_0027_m_000001_0
2013-10-31 18:40:34,157 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000001_0 0.0% 
2013-10-31 18:40:34,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary	dst=null	perm=null
2013-10-31 18:40:34,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:34,244 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_SUCCESS from client DFSClient_attempt_20131031182606197_0027_m_000001_0
2013-10-31 18:40:34,244 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0027_m_000001_0
2013-10-31 18:40:34,248 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2526140641696613949 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2526140641696613949 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2526140641696613949 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6254397619874930752 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6254397619874930752 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:34,250 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6254397619874930752 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027	dst=null	perm=null
2013-10-31 18:40:34,530 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_2526140641696613949_1271 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:34,531 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_6254397619874930752_1272 blk_2526140641696613949_1271 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:35,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data6/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:35,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2526140641696613949_1271 file build/test/data/dfs/data/data5/current/blk_2526140641696613949 for deletion
2013-10-31 18:40:35,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data6/current/blk_-3080819444042136648
2013-10-31 18:40:35,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2526140641696613949_1271 at file build/test/data/dfs/data/data5/current/blk_2526140641696613949
2013-10-31 18:40:35,920 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data5/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:35,921 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data5/current/blk_6192954468864407371
2013-10-31 18:40:36,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data7/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:36,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2526140641696613949_1271 file build/test/data/dfs/data/data8/current/blk_2526140641696613949 for deletion
2013-10-31 18:40:36,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data7/current/blk_-3080819444042136648
2013-10-31 18:40:36,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data7/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:36,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2526140641696613949_1271 at file build/test/data/dfs/data/data8/current/blk_2526140641696613949
2013-10-31 18:40:36,391 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6254397619874930752_1272 file build/test/data/dfs/data/data7/current/blk_6254397619874930752 for deletion
2013-10-31 18:40:36,391 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data7/current/blk_6192954468864407371
2013-10-31 18:40:36,391 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6254397619874930752_1272 at file build/test/data/dfs/data/data7/current/blk_6254397619874930752
2013-10-31 18:40:37,103 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000001_0 0.0% cleanup
2013-10-31 18:40:37,104 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_m_000001_0 is done.
2013-10-31 18:40:37,105 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_m_000001_0  was -1
2013-10-31 18:40:37,105 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:37,531 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_6254397619874930752_1272 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:37,531 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_6254397619874930752_1272 blk_2526140641696613949_1271 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:38,192 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data3/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:38,192 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2526140641696613949_1271 file build/test/data/dfs/data/data4/current/blk_2526140641696613949 for deletion
2013-10-31 18:40:38,192 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data3/current/blk_-3080819444042136648
2013-10-31 18:40:38,192 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data4/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:38,192 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2526140641696613949_1271 at file build/test/data/dfs/data/data4/current/blk_2526140641696613949
2013-10-31 18:40:38,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6254397619874930752_1272 file build/test/data/dfs/data/data3/current/blk_6254397619874930752 for deletion
2013-10-31 18:40:38,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data4/current/blk_6192954468864407371
2013-10-31 18:40:38,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6254397619874930752_1272 at file build/test/data/dfs/data/data3/current/blk_6254397619874930752
2013-10-31 18:40:38,763 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:38,763 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:39,317 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data1/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:39,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data2/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:39,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data1/current/blk_-3080819444042136648
2013-10-31 18:40:39,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6254397619874930752_1272 file build/test/data/dfs/data/data2/current/blk_6254397619874930752 for deletion
2013-10-31 18:40:39,318 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data2/current/blk_6192954468864407371
2013-10-31 18:40:39,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6254397619874930752_1272 at file build/test/data/dfs/data/data2/current/blk_6254397619874930752
2013-10-31 18:40:39,771 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_m_000001_0' has completed task_20131031182606197_0027_m_000001 successfully.
2013-10-31 18:40:39,772 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0027 has completed successfully.
2013-10-31 18:40:39,772 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0027,submitTime=1383244804761,launchTime=1383244804873,firstMapTaskLaunchTime=1383244815599,firstReduceTaskLaunchTime=1383244821739,firstJobSetupTaskLaunchTime=1383244806585,firstJobCleanupTaskLaunchTime=1383244833760,finishTime=1383244839772,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=14,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FAAB6EBD019249188EA583AD21382B9F/B48CA6662923465080E2D1C399F5391B] test/(2/2) ...edpipesplatform/filterall
2013-10-31 18:40:39,776 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650. blk_-5286525445320680021_1277
2013-10-31 18:40:39,778 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5286525445320680021_1277 src: /127.0.0.1:48151 dest: /127.0.0.1:37740
2013-10-31 18:40:39,781 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5286525445320680021_1277 src: /127.0.0.1:51064 dest: /127.0.0.1:34578
2013-10-31 18:40:39,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5286525445320680021_1277 src: /127.0.0.1:48436 dest: /127.0.0.1:54365
2013-10-31 18:40:39,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48436, dest: /127.0.0.1:54365, bytes: 14575, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5286525445320680021_1277, duration: 6936511
2013-10-31 18:40:39,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5286525445320680021_1277 terminating
2013-10-31 18:40:39,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5286525445320680021_1277 size 14575
2013-10-31 18:40:39,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51064, dest: /127.0.0.1:34578, bytes: 14575, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5286525445320680021_1277, duration: 5902215
2013-10-31 18:40:39,794 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5286525445320680021_1277 terminating
2013-10-31 18:40:39,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48151, dest: /127.0.0.1:37740, bytes: 14575, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5286525445320680021_1277, duration: 5203491
2013-10-31 18:40:39,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5286525445320680021_1277 terminating
2013-10-31 18:40:39,798 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5286525445320680021_1277 size 14575
2013-10-31 18:40:39,799 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 from client DFSClient_-856516835
2013-10-31 18:40:39,799 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 is closed by DFSClient_-856516835
2013-10-31 18:40:39,800 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5286525445320680021_1277 size 14575
2013-10-31 18:40:39,806 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:39,806 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_m_000000_0'
2013-10-31 18:40:39,807 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_m_000001_0'
2013-10-31 18:40:39,807 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_m_000002_0'
2013-10-31 18:40:39,807 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_r_000000_0'
2013-10-31 18:40:39,808 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4765952773309717476 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:39,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4765952773309717476 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,809 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4765952773309717476 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,811 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0027_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:39,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027	dst=null	perm=null
2013-10-31 18:40:39,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6068750247121428629 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6068750247121428629 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,815 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6068750247121428629 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:39,816 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6217975784485380900 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,816 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6217975784485380900 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:39,816 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6217975784485380900 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,816 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1380093626912959803 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,816 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1380093626912959803 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:39,817 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1380093626912959803 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6	dst=null	perm=null
2013-10-31 18:40:39,823 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary
2013-10-31 18:40:39,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall	dst=null	perm=null
2013-10-31 18:40:39,843 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:40:39,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000	dst=null	perm=null
2013-10-31 18:40:39,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000	dst=null	perm=null
2013-10-31 18:40:39,846 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/filterall
2013-10-31 18:40:39,847 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:39,847 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0027 being deleted.
2013-10-31 18:40:39,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall	dst=null	perm=null
2013-10-31 18:40:39,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000	dst=null	perm=null
2013-10-31 18:40:39,870 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:40:39,870 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:40:39,885 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] starting
2013-10-31 18:40:39,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:40:39,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename"]
2013-10-31 18:40:39,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  parallel execution is enabled: true
2013-10-31 18:40:39,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  starting jobs: 2
2013-10-31 18:40:39,886 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [merged]  allocating threads: 2
2013-10-31 18:40:39,887 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (1/2)
2013-10-31 18:40:39,890 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:40:39,890 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:40:39,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:39,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:40:39,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,905 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar. blk_-4010317939662345352_1278
2013-10-31 18:40:39,905 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:44264 dest: /127.0.0.1:59471
2013-10-31 18:40:39,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:51068 dest: /127.0.0.1:34578
2013-10-31 18:40:39,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:48440 dest: /127.0.0.1:54365
2013-10-31 18:40:39,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48440, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4010317939662345352_1278, duration: 6607982
2013-10-31 18:40:39,917 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4010317939662345352_1278 terminating
2013-10-31 18:40:39,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51068, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4010317939662345352_1278, duration: 6731047
2013-10-31 18:40:39,917 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4010317939662345352_1278 terminating
2013-10-31 18:40:39,918 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44264, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4010317939662345352_1278, duration: 8097512
2013-10-31 18:40:39,918 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:39,919 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4010317939662345352_1278 terminating
2013-10-31 18:40:39,920 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:39,920 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:39,921 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar from client DFSClient_-1596270109
2013-10-31 18:40:39,921 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:40:39,926 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar. New replication is 10
2013-10-31 18:40:39,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=null
2013-10-31 18:40:39,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,941 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:40:39,947 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:40:39,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:40:39,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,966 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split. New replication is 10
2013-10-31 18:40:39,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=null
2013-10-31 18:40:39,975 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split. blk_-235108636050631590_1279
2013-10-31 18:40:39,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:51070 dest: /127.0.0.1:34578
2013-10-31 18:40:39,977 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:48159 dest: /127.0.0.1:37740
2013-10-31 18:40:39,978 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:44269 dest: /127.0.0.1:59471
2013-10-31 18:40:39,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:48444 dest: /127.0.0.1:54365
2013-10-31 18:40:39,982 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48444, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-235108636050631590_1279, duration: 1140844
2013-10-31 18:40:39,982 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44269, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-235108636050631590_1279, duration: 618434
2013-10-31 18:40:39,983 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48159, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-235108636050631590_1279, duration: 1685836
2013-10-31 18:40:39,983 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51070, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-235108636050631590_1279, duration: 1433285
2013-10-31 18:40:39,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,987 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,987 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split from client DFSClient_-1596270109
2013-10-31 18:40:39,987 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split is closed by DFSClient_-1596270109
2013-10-31 18:40:39,987 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,987 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,988 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,007 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo. blk_-2267545822353736092_1280
2013-10-31 18:40:40,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2267545822353736092_1280 src: /127.0.0.1:48162 dest: /127.0.0.1:37740
2013-10-31 18:40:40,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2267545822353736092_1280 src: /127.0.0.1:51075 dest: /127.0.0.1:34578
2013-10-31 18:40:40,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2267545822353736092_1280 src: /127.0.0.1:48447 dest: /127.0.0.1:54365
2013-10-31 18:40:40,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48447, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2267545822353736092_1280, duration: 849243
2013-10-31 18:40:40,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2267545822353736092_1280 terminating
2013-10-31 18:40:40,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51075, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2267545822353736092_1280, duration: 673079
2013-10-31 18:40:40,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2267545822353736092_1280 terminating
2013-10-31 18:40:40,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48162, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2267545822353736092_1280, duration: 1496977
2013-10-31 18:40:40,015 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2267545822353736092_1280 terminating
2013-10-31 18:40:40,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2267545822353736092_1280 size 156
2013-10-31 18:40:40,017 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2267545822353736092_1280 size 156
2013-10-31 18:40:40,017 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:40:40,017 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:40:40,018 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2267545822353736092_1280 size 156
2013-10-31 18:40:40,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,042 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml. blk_5626442093913306657_1281
2013-10-31 18:40:40,043 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5626442093913306657_1281 src: /127.0.0.1:48165 dest: /127.0.0.1:37740
2013-10-31 18:40:40,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5626442093913306657_1281 src: /127.0.0.1:48449 dest: /127.0.0.1:54365
2013-10-31 18:40:40,046 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5626442093913306657_1281 src: /127.0.0.1:44276 dest: /127.0.0.1:59471
2013-10-31 18:40:40,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44276, dest: /127.0.0.1:59471, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5626442093913306657_1281, duration: 1174480
2013-10-31 18:40:40,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5626442093913306657_1281 terminating
2013-10-31 18:40:40,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48449, dest: /127.0.0.1:54365, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 785379
2013-10-31 18:40:40,048 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5626442093913306657_1281 terminating
2013-10-31 18:40:40,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48165, dest: /127.0.0.1:37740, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5626442093913306657_1281, duration: 1208724
2013-10-31 18:40:40,049 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5626442093913306657_1281 terminating
2013-10-31 18:40:40,051 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5626442093913306657_1281 size 27454
2013-10-31 18:40:40,052 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5626442093913306657_1281 size 27454
2013-10-31 18:40:40,052 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml from client DFSClient_-1596270109
2013-10-31 18:40:40,052 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:40:40,053 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5626442093913306657_1281 size 27454
2013-10-31 18:40:40,532 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-4010317939662345352_1278 to datanode(s) 127.0.0.1:37740
2013-10-31 18:40:40,533 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_6068750247121428629_1268 blk_-4765952773309717476_1275 blk_-1380093626912959803_1267 blk_-6217975784485380900_1265
2013-10-31 18:40:40,533 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_6068750247121428629_1268 blk_-4765952773309717476_1275 blk_-1380093626912959803_1267 blk_-6217975784485380900_1265
2013-10-31 18:40:40,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=null
2013-10-31 18:40:40,741 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48169, bytes: 27670, op: HDFS_READ, cliID: DFSClient_489287705, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5626442093913306657_1281, duration: 429357
2013-10-31 18:40:40,748 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0028: nMaps=4 nReduces=0 max=-1
2013-10-31 18:40:40,749 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0028 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:40:40,749 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0028	RESULT=SUCCESS
2013-10-31 18:40:40,749 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0028
2013-10-31 18:40:40,749 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0028
2013-10-31 18:40:40,750 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0028
2013-10-31 18:40:40,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,779 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml. blk_-566339595978537805_1283
2013-10-31 18:40:40,781 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-566339595978537805_1283 src: /127.0.0.1:48453 dest: /127.0.0.1:54365
2013-10-31 18:40:40,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-566339595978537805_1283 src: /127.0.0.1:48171 dest: /127.0.0.1:37740
2013-10-31 18:40:40,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-566339595978537805_1283 src: /127.0.0.1:51084 dest: /127.0.0.1:34578
2013-10-31 18:40:40,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51084, dest: /127.0.0.1:34578, bytes: 27519, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-566339595978537805_1283, duration: 519613
2013-10-31 18:40:40,789 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-566339595978537805_1283 terminating
2013-10-31 18:40:40,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48171, dest: /127.0.0.1:37740, bytes: 27519, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-566339595978537805_1283, duration: 1392949
2013-10-31 18:40:40,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-566339595978537805_1283 terminating
2013-10-31 18:40:40,790 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-566339595978537805_1283 size 27519
2013-10-31 18:40:40,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48453, dest: /127.0.0.1:54365, bytes: 27519, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-566339595978537805_1283, duration: 2270880
2013-10-31 18:40:40,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-566339595978537805_1283 terminating
2013-10-31 18:40:40,791 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-566339595978537805_1283 size 27519
2013-10-31 18:40:40,793 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml from client DFSClient_489287705
2013-10-31 18:40:40,793 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml is closed by DFSClient_489287705
2013-10-31 18:40:40,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-566339595978537805_1283 size 27519
2013-10-31 18:40:40,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,804 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken. blk_295024924997773881_1284
2013-10-31 18:40:40,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295024924997773881_1284 src: /127.0.0.1:48173 dest: /127.0.0.1:37740
2013-10-31 18:40:40,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295024924997773881_1284 src: /127.0.0.1:44283 dest: /127.0.0.1:59471
2013-10-31 18:40:40,809 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295024924997773881_1284 src: /127.0.0.1:51087 dest: /127.0.0.1:34578
2013-10-31 18:40:40,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51087, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 68859
2013-10-31 18:40:40,812 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_295024924997773881_1284 terminating
2013-10-31 18:40:40,812 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44283, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_295024924997773881_1284, duration: 846879
2013-10-31 18:40:40,813 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_295024924997773881_1284 terminating
2013-10-31 18:40:40,813 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_295024924997773881_1284 size 116
2013-10-31 18:40:40,813 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48173, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_295024924997773881_1284, duration: 1735488
2013-10-31 18:40:40,814 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_295024924997773881_1284 terminating
2013-10-31 18:40:40,815 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_295024924997773881_1284 size 116
2013-10-31 18:40:40,816 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_295024924997773881_1284 size 116
2013-10-31 18:40:40,816 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken from client DFSClient_-1596270109
2013-10-31 18:40:40,817 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:40:40,822 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken
2013-10-31 18:40:40,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:40:40,826 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48459, bytes: 160, op: HDFS_READ, cliID: DFSClient_489287705, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2267545822353736092_1280, duration: 280292
2013-10-31 18:40:40,827 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0028 = 1449. Number of splits = 4
2013-10-31 18:40:40,827 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0028 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:40:40,831 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0028 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:40:41,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6217975784485380900_1265 file build/test/data/dfs/data/data3/current/blk_-6217975784485380900 for deletion
2013-10-31 18:40:41,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4765952773309717476_1275 file build/test/data/dfs/data/data4/current/blk_-4765952773309717476 for deletion
2013-10-31 18:40:41,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6217975784485380900_1265 at file build/test/data/dfs/data/data3/current/blk_-6217975784485380900
2013-10-31 18:40:41,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4765952773309717476_1275 at file build/test/data/dfs/data/data4/current/blk_-4765952773309717476
2013-10-31 18:40:41,193 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1380093626912959803_1267 file build/test/data/dfs/data/data4/current/blk_-1380093626912959803 for deletion
2013-10-31 18:40:41,194 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6068750247121428629_1268 file build/test/data/dfs/data/data3/current/blk_6068750247121428629 for deletion
2013-10-31 18:40:41,194 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1380093626912959803_1267 at file build/test/data/dfs/data/data4/current/blk_-1380093626912959803
2013-10-31 18:40:41,194 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6068750247121428629_1268 at file build/test/data/dfs/data/data3/current/blk_6068750247121428629
2013-10-31 18:40:41,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6217975784485380900_1265 file build/test/data/dfs/data/data5/current/blk_-6217975784485380900 for deletion
2013-10-31 18:40:41,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4765952773309717476_1275 file build/test/data/dfs/data/data5/current/blk_-4765952773309717476 for deletion
2013-10-31 18:40:41,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6217975784485380900_1265 at file build/test/data/dfs/data/data5/current/blk_-6217975784485380900
2013-10-31 18:40:41,922 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1380093626912959803_1267 file build/test/data/dfs/data/data5/current/blk_-1380093626912959803 for deletion
2013-10-31 18:40:41,923 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4765952773309717476_1275 at file build/test/data/dfs/data/data5/current/blk_-4765952773309717476
2013-10-31 18:40:41,923 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6068750247121428629_1268 file build/test/data/dfs/data/data6/current/blk_6068750247121428629 for deletion
2013-10-31 18:40:41,923 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1380093626912959803_1267 at file build/test/data/dfs/data/data5/current/blk_-1380093626912959803
2013-10-31 18:40:41,923 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6068750247121428629_1268 at file build/test/data/dfs/data/data6/current/blk_6068750247121428629
2013-10-31 18:40:42,319 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-4010317939662345352_1278 to 127.0.0.1:37740 
2013-10-31 18:40:42,321 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:48177 dest: /127.0.0.1:37740
2013-10-31 18:40:42,321 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-4010317939662345352_1278 to /127.0.0.1:37740
2013-10-31 18:40:42,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4010317939662345352_1278 src: /127.0.0.1:48177 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:40:42,326 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:42,765 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0028_m_000005_0' to tip task_20131031182606197_0028_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:40:42,772 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:40:42,772 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000005_0 which needs 1 slots
2013-10-31 18:40:42,772 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:42,773 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000005_0 which needs 1 slots
2013-10-31 18:40:42,773 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0027 being deleted.
2013-10-31 18:40:42,776 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:42,776 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0027 being deleted.
2013-10-31 18:40:42,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken	dst=null	perm=null
2013-10-31 18:40:42,783 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51090, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 306291
2013-10-31 18:40:42,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=null
2013-10-31 18:40:42,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48463, bytes: 27670, op: HDFS_READ, cliID: DFSClient_1728021546, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 382530
2013-10-31 18:40:42,815 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:42,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=null
2013-10-31 18:40:42,832 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51093, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1728021546, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4010317939662345352_1278, duration: 1145755
2013-10-31 18:40:42,927 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-284700878
2013-10-31 18:40:42,929 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-284700878 spawned.
2013-10-31 18:40:42,931 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000005_0/taskjvm.sh
2013-10-31 18:40:43,533 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_6068750247121428629_1268 blk_-4765952773309717476_1275
2013-10-31 18:40:43,534 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-1380093626912959803_1267 blk_-6217975784485380900_1265
2013-10-31 18:40:44,055 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-284700878 given task: attempt_20131031182606197_0028_m_000005_0
2013-10-31 18:40:44,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:44,809 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:44,809 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0027_m_000001_0 not found in cache
2013-10-31 18:40:44,811 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383331244810
2013-10-31 18:40:45,141 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0027_m_1809268964 since job job_20131031182606197_0027 is dead
2013-10-31 18:40:45,152 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32203 with signal TERM. Exit code 0
2013-10-31 18:40:45,313 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:45,313 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:45,313 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:45,313 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0027_m_1809268964 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:40:45,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4765952773309717476_1275 file build/test/data/dfs/data/data2/current/blk_-4765952773309717476 for deletion
2013-10-31 18:40:45,319 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6068750247121428629_1268 file build/test/data/dfs/data/data1/current/blk_6068750247121428629 for deletion
2013-10-31 18:40:45,320 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4765952773309717476_1275 at file build/test/data/dfs/data/data2/current/blk_-4765952773309717476
2013-10-31 18:40:45,320 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6068750247121428629_1268 at file build/test/data/dfs/data/data1/current/blk_6068750247121428629
2013-10-31 18:40:45,392 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6217975784485380900_1265 file build/test/data/dfs/data/data7/current/blk_-6217975784485380900 for deletion
2013-10-31 18:40:45,393 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1380093626912959803_1267 file build/test/data/dfs/data/data8/current/blk_-1380093626912959803 for deletion
2013-10-31 18:40:45,393 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6217975784485380900_1265 at file build/test/data/dfs/data/data7/current/blk_-6217975784485380900
2013-10-31 18:40:45,393 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1380093626912959803_1267 at file build/test/data/dfs/data/data8/current/blk_-1380093626912959803
2013-10-31 18:40:45,551 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0027_m_1741630968 since job job_20131031182606197_0027 is dead
2013-10-31 18:40:45,575 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32085 with signal TERM. Exit code 0
2013-10-31 18:40:45,729 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:45,729 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:45,729 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:45,730 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0027_m_1741630968 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:46,190 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0027_r_95840884 since job job_20131031182606197_0027 is dead
2013-10-31 18:40:46,201 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32267 with signal TERM. Exit code 0
2013-10-31 18:40:46,369 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:46,369 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:46,369 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:40:46,369 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0027_r_95840884 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:47,534 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000005_0 0.0% setup
2013-10-31 18:40:47,537 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000005_0 is done.
2013-10-31 18:40:47,538 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000005_0  was -1
2013-10-31 18:40:47,538 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:48,778 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000005_0' has completed task_20131031182606197_0028_m_000005 successfully.
2013-10-31 18:40:48,782 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000000_0' to tip task_20131031182606197_0028_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:40:48,783 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000000
2013-10-31 18:40:48,786 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000001_0' to tip task_20131031182606197_0028_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:40:48,786 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:40:48,786 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000001
2013-10-31 18:40:48,786 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000000_0 which needs 1 slots
2013-10-31 18:40:48,787 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000000_0 which needs 1 slots
2013-10-31 18:40:48,788 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:40:48,789 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000001_0 which needs 1 slots
2013-10-31 18:40:48,789 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000001_0 which needs 1 slots
2013-10-31 18:40:48,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken	dst=null	perm=null
2013-10-31 18:40:48,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48185, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_295024924997773881_1284, duration: 303098
2013-10-31 18:40:48,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=null
2013-10-31 18:40:48,809 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44296, bytes: 27670, op: HDFS_READ, cliID: DFSClient_1860863364, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5626442093913306657_1281, duration: 404260
2013-10-31 18:40:48,818 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000002_0' to tip task_20131031182606197_0028_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:48,818 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000002
2013-10-31 18:40:48,818 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_474040702
2013-10-31 18:40:48,819 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_474040702 spawned.
2013-10-31 18:40:48,822 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:40:48,823 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000002_0 which needs 1 slots
2013-10-31 18:40:48,824 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000002_0 which needs 1 slots
2013-10-31 18:40:48,824 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000000_0/taskjvm.sh
2013-10-31 18:40:48,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken	dst=null	perm=null
2013-10-31 18:40:48,830 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51100, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 137280
2013-10-31 18:40:48,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=null
2013-10-31 18:40:48,837 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48473, bytes: 27670, op: HDFS_READ, cliID: DFSClient_-894416312, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 155192
2013-10-31 18:40:48,854 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000003_0' to tip task_20131031182606197_0028_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:40:48,861 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:48,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=null
2013-10-31 18:40:48,894 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51103, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-894416312, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4010317939662345352_1278, duration: 1460928
2013-10-31 18:40:48,894 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000003
2013-10-31 18:40:48,895 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:48,896 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:40:48,897 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000003_0 which needs 1 slots
2013-10-31 18:40:48,897 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000003_0 which needs 1 slots
2013-10-31 18:40:48,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken	dst=null	perm=null
2013-10-31 18:40:48,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51104, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 269492
2013-10-31 18:40:48,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml	dst=null	perm=null
2013-10-31 18:40:48,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48477, bytes: 27670, op: HDFS_READ, cliID: DFSClient_1257678314, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 407331
2013-10-31 18:40:48,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=null
2013-10-31 18:40:48,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48478, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1860863364, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4010317939662345352_1278, duration: 2293101
2013-10-31 18:40:48,974 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:48,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar	dst=null	perm=null
2013-10-31 18:40:48,990 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48196, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1257678314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4010317939662345352_1278, duration: 588770
2013-10-31 18:40:49,001 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-475802321
2013-10-31 18:40:49,002 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-475802321 spawned.
2013-10-31 18:40:49,003 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000002_0/taskjvm.sh
2013-10-31 18:40:49,021 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-1504316073
2013-10-31 18:40:49,022 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-1504316073 spawned.
2013-10-31 18:40:49,023 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000001_0/taskjvm.sh
2013-10-31 18:40:49,618 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-2144061624
2013-10-31 18:40:49,619 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-2144061624 spawned.
2013-10-31 18:40:49,621 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000003_0/taskjvm.sh
2013-10-31 18:40:49,744 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_474040702 given task: attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:50,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=null
2013-10-31 18:40:50,238 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48199, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-235108636050631590_1279, duration: 171461
2013-10-31 18:40:50,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:40:50,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48200, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 140573
2013-10-31 18:40:50,285 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1489 Total time for transactions(ms): 30Number of transactions batched in Syncs: 127 Number of syncs: 1038 SyncTimes(ms): 68572 16024 
2013-10-31 18:40:50,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:50,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:50,482 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000. blk_6468364575429809189_1285
2013-10-31 18:40:50,501 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-475802321 given task: attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:50,506 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6468364575429809189_1285 src: /127.0.0.1:48487 dest: /127.0.0.1:54365
2013-10-31 18:40:50,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6468364575429809189_1285 src: /127.0.0.1:51117 dest: /127.0.0.1:34578
2013-10-31 18:40:50,508 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6468364575429809189_1285 src: /127.0.0.1:44315 dest: /127.0.0.1:59471
2013-10-31 18:40:50,510 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44315, dest: /127.0.0.1:59471, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6468364575429809189_1285, duration: 1415554
2013-10-31 18:40:50,510 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6468364575429809189_1285 terminating
2013-10-31 18:40:50,511 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51117, dest: /127.0.0.1:34578, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6468364575429809189_1285, duration: 1560121
2013-10-31 18:40:50,511 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6468364575429809189_1285 terminating
2013-10-31 18:40:50,511 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48487, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6468364575429809189_1285, duration: 1956243
2013-10-31 18:40:50,511 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6468364575429809189_1285 terminating
2013-10-31 18:40:50,511 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6468364575429809189_1285 size 264
2013-10-31 18:40:50,512 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:50,512 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:50,513 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6468364575429809189_1285 size 264
2013-10-31 18:40:50,515 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6468364575429809189_1285 size 264
2013-10-31 18:40:50,556 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:50,557 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000000_0 0.0% 
2013-10-31 18:40:50,598 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-1504316073 given task: attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:50,615 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-2144061624 given task: attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:51,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=null
2013-10-31 18:40:51,028 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48492, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-235108636050631590_1279, duration: 169924
2013-10-31 18:40:51,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:40:51,068 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51122, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 164097
2013-10-31 18:40:51,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:51,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=null
2013-10-31 18:40:51,099 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48212, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-235108636050631590_1279, duration: 155948
2013-10-31 18:40:51,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:51,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:40:51,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:51,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split	dst=null	perm=null
2013-10-31 18:40:51,159 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48496, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-235108636050631590_1279, duration: 157782
2013-10-31 18:40:51,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:51,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:40:51,199 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48497, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 156828
2013-10-31 18:40:51,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:51,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:51,273 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002. blk_1749832804603777904_1288
2013-10-31 18:40:51,296 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1749832804603777904_1288 src: /127.0.0.1:44324 dest: /127.0.0.1:59471
2013-10-31 18:40:51,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1749832804603777904_1288 src: /127.0.0.1:48216 dest: /127.0.0.1:37740
2013-10-31 18:40:51,298 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1749832804603777904_1288 src: /127.0.0.1:51129 dest: /127.0.0.1:34578
2013-10-31 18:40:51,300 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51129, dest: /127.0.0.1:34578, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1749832804603777904_1288, duration: 1366513
2013-10-31 18:40:51,300 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1749832804603777904_1288 terminating
2013-10-31 18:40:51,301 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48216, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1749832804603777904_1288, duration: 1509898
2013-10-31 18:40:51,301 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1749832804603777904_1288 terminating
2013-10-31 18:40:51,301 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44324, dest: /127.0.0.1:59471, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1749832804603777904_1288, duration: 1847903
2013-10-31 18:40:51,301 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1749832804603777904_1288 terminating
2013-10-31 18:40:51,303 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1749832804603777904_1288 size 70
2013-10-31 18:40:51,304 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1749832804603777904_1288 size 70
2013-10-31 18:40:51,305 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1749832804603777904_1288 size 70
2013-10-31 18:40:51,339 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51130, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 162141
2013-10-31 18:40:51,343 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001. blk_-4446515941025710904_1288
2013-10-31 18:40:51,366 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4446515941025710904_1288 src: /127.0.0.1:51131 dest: /127.0.0.1:34578
2013-10-31 18:40:51,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4446515941025710904_1288 src: /127.0.0.1:44329 dest: /127.0.0.1:59471
2013-10-31 18:40:51,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4446515941025710904_1288 src: /127.0.0.1:48504 dest: /127.0.0.1:54365
2013-10-31 18:40:51,369 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48504, dest: /127.0.0.1:54365, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4446515941025710904_1288, duration: 861948
2013-10-31 18:40:51,369 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4446515941025710904_1288 terminating
2013-10-31 18:40:51,369 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4446515941025710904_1288 size 217
2013-10-31 18:40:51,370 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44329, dest: /127.0.0.1:59471, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4446515941025710904_1288, duration: 1215168
2013-10-31 18:40:51,370 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4446515941025710904_1288 terminating
2013-10-31 18:40:51,370 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51131, dest: /127.0.0.1:34578, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4446515941025710904_1288, duration: 1659449
2013-10-31 18:40:51,370 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4446515941025710904_1288 terminating
2013-10-31 18:40:51,371 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4446515941025710904_1288 size 217
2013-10-31 18:40:51,371 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:51,371 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:51,374 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4446515941025710904_1288 size 217
2013-10-31 18:40:51,665 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003. blk_1964692028297874732_1288
2013-10-31 18:40:51,703 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:51,703 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:51,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1964692028297874732_1288 src: /127.0.0.1:51134 dest: /127.0.0.1:34578
2013-10-31 18:40:51,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1964692028297874732_1288 src: /127.0.0.1:48506 dest: /127.0.0.1:54365
2013-10-31 18:40:51,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1964692028297874732_1288 src: /127.0.0.1:44333 dest: /127.0.0.1:59471
2013-10-31 18:40:51,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44333, dest: /127.0.0.1:59471, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1964692028297874732_1288, duration: 1610468
2013-10-31 18:40:51,720 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1964692028297874732_1288 terminating
2013-10-31 18:40:51,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48506, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1964692028297874732_1288, duration: 3999694
2013-10-31 18:40:51,721 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1964692028297874732_1288 terminating
2013-10-31 18:40:51,721 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51134, dest: /127.0.0.1:34578, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1964692028297874732_1288, duration: 4430597
2013-10-31 18:40:51,721 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1964692028297874732_1288 terminating
2013-10-31 18:40:51,722 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1964692028297874732_1288 size 264
2013-10-31 18:40:51,722 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:51,722 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:51,724 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1964692028297874732_1288 size 264
2013-10-31 18:40:51,724 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1964692028297874732_1288 size 264
2013-10-31 18:40:51,747 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:51,747 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000001_0 0.0% 
2013-10-31 18:40:51,755 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:51,755 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000002_0 0.0% 
2013-10-31 18:40:51,766 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:51,766 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000003_0 0.0% 
2013-10-31 18:40:51,788 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:51,792 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:51,825 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:51,901 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:52,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0	dst=null	perm=null
2013-10-31 18:40:52,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000	dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0	dst=null	perm=null
2013-10-31 18:40:52,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0	dst=null	perm=null
2013-10-31 18:40:52,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0	dst=null	perm=null
2013-10-31 18:40:52,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001	dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0	dst=null	perm=null
2013-10-31 18:40:52,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0	dst=null	perm=null
2013-10-31 18:40:52,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002	dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,782 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3853691654878838440_1011
2013-10-31 18:40:52,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0	dst=null	perm=null
2013-10-31 18:40:52,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003	dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0	dst=null	perm=null
2013-10-31 18:40:53,167 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:40:53,169 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000000_0 is done.
2013-10-31 18:40:53,169 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000000_0  was -1
2013-10-31 18:40:53,170 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:53,787 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0028_m_000005_0
2013-10-31 18:40:53,787 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0028_m_000005_0
2013-10-31 18:40:53,787 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000005_0 not found in cache
2013-10-31 18:40:53,956 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:40:53,957 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000002_0 is done.
2013-10-31 18:40:53,958 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000002_0  was -1
2013-10-31 18:40:53,958 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:54,021 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:40:54,022 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000001_0 is done.
2013-10-31 18:40:54,022 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000001_0  was -1
2013-10-31 18:40:54,022 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:54,085 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:40:54,086 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000003_0 is done.
2013-10-31 18:40:54,086 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000003_0  was -1
2013-10-31 18:40:54,087 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:54,792 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000000_0' has completed task_20131031182606197_0028_m_000000 successfully.
2013-10-31 18:40:54,794 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000001_0' has completed task_20131031182606197_0028_m_000001 successfully.
2013-10-31 18:40:54,828 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000002_0' has completed task_20131031182606197_0028_m_000002 successfully.
2013-10-31 18:40:54,904 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000003_0' has completed task_20131031182606197_0028_m_000003 successfully.
2013-10-31 18:40:54,906 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0028_m_000004_0' to tip task_20131031182606197_0028_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:40:54,909 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:40:54,909 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000004_0 which needs 1 slots
2013-10-31 18:40:54,909 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000004_0 which needs 1 slots
2013-10-31 18:40:54,947 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-1006496814
2013-10-31 18:40:54,948 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-1006496814 spawned.
2013-10-31 18:40:54,950 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000004_0/taskjvm.sh
2013-10-31 18:40:55,926 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-1006496814 given task: attempt_20131031182606197_0028_m_000004_0
2013-10-31 18:40:55,999 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:40:56,005 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,010 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,032 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:40:56,439 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000004_0 0.0% 
2013-10-31 18:40:57,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary	dst=null	perm=null
2013-10-31 18:40:57,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:57,305 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_SUCCESS from client DFSClient_attempt_20131031182606197_0028_m_000004_0
2013-10-31 18:40:57,305 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0028_m_000004_0
2013-10-31 18:40:57,311 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,312 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:57,312 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:57,312 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,312 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,313 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,313 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:57,313 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:57,313 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2267545822353736092 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,313 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2267545822353736092 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:57,314 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2267545822353736092 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,314 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5626442093913306657 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,314 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5626442093913306657 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,314 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5626442093913306657 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:57,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028	dst=null	perm=null
2013-10-31 18:40:58,536 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_-2267545822353736092_1280
2013-10-31 18:40:58,536 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5626442093913306657_1281 blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_-2267545822353736092_1280
2013-10-31 18:40:59,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data4/current/blk_-4010317939662345352 for deletion
2013-10-31 18:40:59,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2267545822353736092_1280 file build/test/data/dfs/data/data4/current/blk_-2267545822353736092 for deletion
2013-10-31 18:40:59,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data3/current/blk_-235108636050631590 for deletion
2013-10-31 18:40:59,199 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data4/current/blk_-4010317939662345352
2013-10-31 18:40:59,200 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data3/current/blk_-235108636050631590
2013-10-31 18:40:59,200 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2267545822353736092_1280 at file build/test/data/dfs/data/data4/current/blk_-2267545822353736092
2013-10-31 18:40:59,200 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5626442093913306657_1281 file build/test/data/dfs/data/data3/current/blk_5626442093913306657 for deletion
2013-10-31 18:40:59,201 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5626442093913306657_1281 at file build/test/data/dfs/data/data3/current/blk_5626442093913306657
2013-10-31 18:40:59,373 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000004_0 0.0% cleanup
2013-10-31 18:40:59,375 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000004_0 is done.
2013-10-31 18:40:59,375 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000004_0  was -1
2013-10-31 18:40:59,376 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:00,325 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data2/current/blk_-4010317939662345352 for deletion
2013-10-31 18:41:00,325 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2267545822353736092_1280 file build/test/data/dfs/data/data2/current/blk_-2267545822353736092 for deletion
2013-10-31 18:41:00,325 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data1/current/blk_-235108636050631590 for deletion
2013-10-31 18:41:00,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data2/current/blk_-4010317939662345352
2013-10-31 18:41:00,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data1/current/blk_-235108636050631590
2013-10-31 18:41:00,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2267545822353736092_1280 at file build/test/data/dfs/data/data2/current/blk_-2267545822353736092
2013-10-31 18:41:00,917 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000004_0' has completed task_20131031182606197_0028_m_000004 successfully.
2013-10-31 18:41:00,918 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0028 has completed successfully.
2013-10-31 18:41:00,918 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0028,submitTime=1383244840735,launchTime=1383244840831,firstMapTaskLaunchTime=1383244848782,firstJobSetupTaskLaunchTime=1383244842765,firstJobCleanupTaskLaunchTime=1383244854906,finishTime=1383244860918,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[AA2052F0D79D45CC875DDB141C76CED5/05016FD470A8431585730710D69FB2A9] merged/(1/2)
2013-10-31 18:41:00,923 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315. blk_6893710486870095770_1289
2013-10-31 18:41:00,925 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6893710486870095770_1289 src: /127.0.0.1:48512 dest: /127.0.0.1:54365
2013-10-31 18:41:00,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6893710486870095770_1289 src: /127.0.0.1:48230 dest: /127.0.0.1:37740
2013-10-31 18:41:00,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6893710486870095770_1289 src: /127.0.0.1:51143 dest: /127.0.0.1:34578
2013-10-31 18:41:00,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51143, dest: /127.0.0.1:34578, bytes: 22419, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6893710486870095770_1289, duration: 305840
2013-10-31 18:41:00,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6893710486870095770_1289 terminating
2013-10-31 18:41:00,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48230, dest: /127.0.0.1:37740, bytes: 22419, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6893710486870095770_1289, duration: 1295568
2013-10-31 18:41:00,975 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6893710486870095770_1289 terminating
2013-10-31 18:41:00,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6893710486870095770_1289 size 22419
2013-10-31 18:41:00,975 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48512, dest: /127.0.0.1:54365, bytes: 22419, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6893710486870095770_1289, duration: 2366979
2013-10-31 18:41:00,976 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6893710486870095770_1289 terminating
2013-10-31 18:41:00,980 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6893710486870095770_1289 size 22419
2013-10-31 18:41:00,981 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 from client DFSClient_489287705
2013-10-31 18:41:00,981 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 is closed by DFSClient_489287705
2013-10-31 18:41:00,982 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6893710486870095770_1289 size 22419
2013-10-31 18:41:00,990 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:00,991 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000003_0'
2013-10-31 18:41:00,991 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000004_0'
2013-10-31 18:41:00,992 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295024924997773881 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:00,992 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295024924997773881 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:00,992 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295024924997773881 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:00,994 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (2/2) ...splitsourcemergedsamename
2013-10-31 18:41:00,997 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0028_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:00,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028	dst=null	perm=null
2013-10-31 18:41:01,035 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:41:01,035 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:41:01,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:01,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:41:01,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:01,057 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar. blk_1804964651075253424_1290
2013-10-31 18:41:01,058 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:48516 dest: /127.0.0.1:54365
2013-10-31 18:41:01,060 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:44343 dest: /127.0.0.1:59471
2013-10-31 18:41:01,061 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:48235 dest: /127.0.0.1:37740
2013-10-31 18:41:01,069 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48235, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1804964651075253424_1290, duration: 4946033
2013-10-31 18:41:01,069 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1804964651075253424_1290 terminating
2013-10-31 18:41:01,070 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44343, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1804964651075253424_1290, duration: 5383409
2013-10-31 18:41:01,070 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1804964651075253424_1290 terminating
2013-10-31 18:41:01,070 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48516, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1804964651075253424_1290, duration: 6002253
2013-10-31 18:41:01,071 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1804964651075253424_1290 terminating
2013-10-31 18:41:01,072 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:01,072 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar from client DFSClient_-1596270109
2013-10-31 18:41:01,072 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:41:01,073 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:01,074 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:01,078 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar. New replication is 10
2013-10-31 18:41:01,537 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_1804964651075253424_1290 to datanode(s) 127.0.0.1:34578
2013-10-31 18:41:01,537 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_295024924997773881_1284
2013-10-31 18:41:01,538 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5626442093913306657_1281 blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_295024924997773881_1284
2013-10-31 18:41:02,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=null
2013-10-31 18:41:02,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,779 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:41:02,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75	dst=null	perm=null
2013-10-31 18:41:02,784 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:41:02,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000	dst=null	perm=null
2013-10-31 18:41:02,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001	dst=null	perm=null
2013-10-31 18:41:02,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002	dst=null	perm=null
2013-10-31 18:41:02,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003	dst=null	perm=null
2013-10-31 18:41:02,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,801 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split. New replication is 10
2013-10-31 18:41:02,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=null
2013-10-31 18:41:02,810 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split. blk_-2443861200343278733_1291
2013-10-31 18:41:02,812 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:48236 dest: /127.0.0.1:37740
2013-10-31 18:41:02,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:51149 dest: /127.0.0.1:34578
2013-10-31 18:41:02,815 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:48521 dest: /127.0.0.1:54365
2013-10-31 18:41:02,817 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:44348 dest: /127.0.0.1:59471
2013-10-31 18:41:02,820 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44348, dest: /127.0.0.1:59471, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2443861200343278733_1291, duration: 120213
2013-10-31 18:41:02,821 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,821 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48521, dest: /127.0.0.1:54365, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2443861200343278733_1291, duration: 989064
2013-10-31 18:41:02,822 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,822 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51149, dest: /127.0.0.1:34578, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2443861200343278733_1291, duration: 1899330
2013-10-31 18:41:02,822 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,823 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,823 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48236, dest: /127.0.0.1:37740, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2443861200343278733_1291, duration: 2954898
2013-10-31 18:41:02,824 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,824 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,828 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,829 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split from client DFSClient_-1596270109
2013-10-31 18:41:02,829 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split is closed by DFSClient_-1596270109
2013-10-31 18:41:02,829 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,847 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo. blk_-1212781167072705890_1292
2013-10-31 18:41:02,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1212781167072705890_1292 src: /127.0.0.1:44349 dest: /127.0.0.1:59471
2013-10-31 18:41:02,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1212781167072705890_1292 src: /127.0.0.1:48524 dest: /127.0.0.1:54365
2013-10-31 18:41:02,852 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1212781167072705890_1292 src: /127.0.0.1:51154 dest: /127.0.0.1:34578
2013-10-31 18:41:02,854 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51154, dest: /127.0.0.1:34578, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1212781167072705890_1292, duration: 66400
2013-10-31 18:41:02,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1212781167072705890_1292 terminating
2013-10-31 18:41:02,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48524, dest: /127.0.0.1:54365, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1212781167072705890_1292, duration: 1017451
2013-10-31 18:41:02,856 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1212781167072705890_1292 size 153
2013-10-31 18:41:02,856 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1212781167072705890_1292 terminating
2013-10-31 18:41:02,856 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44349, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1212781167072705890_1292, duration: 1974738
2013-10-31 18:41:02,856 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1212781167072705890_1292 size 153
2013-10-31 18:41:02,857 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1212781167072705890_1292 terminating
2013-10-31 18:41:02,859 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:41:02,860 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:41:02,861 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1212781167072705890_1292 size 153
2013-10-31 18:41:02,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,885 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml. blk_243604678923041825_1293
2013-10-31 18:41:02,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_243604678923041825_1293 src: /127.0.0.1:48526 dest: /127.0.0.1:54365
2013-10-31 18:41:02,888 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_243604678923041825_1293 src: /127.0.0.1:51156 dest: /127.0.0.1:34578
2013-10-31 18:41:02,890 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_243604678923041825_1293 src: /127.0.0.1:48245 dest: /127.0.0.1:37740
2013-10-31 18:41:02,892 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48245, dest: /127.0.0.1:37740, bytes: 28283, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_243604678923041825_1293, duration: 68596
2013-10-31 18:41:02,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_243604678923041825_1293 terminating
2013-10-31 18:41:02,893 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_243604678923041825_1293 size 28283
2013-10-31 18:41:02,893 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51156, dest: /127.0.0.1:34578, bytes: 28283, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 868089
2013-10-31 18:41:02,894 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_243604678923041825_1293 terminating
2013-10-31 18:41:02,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48526, dest: /127.0.0.1:54365, bytes: 28283, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_243604678923041825_1293, duration: 1804151
2013-10-31 18:41:02,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_243604678923041825_1293 terminating
2013-10-31 18:41:02,896 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_243604678923041825_1293 size 28283
2013-10-31 18:41:02,897 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml from client DFSClient_-1596270109
2013-10-31 18:41:02,897 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:41:02,898 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_243604678923041825_1293 size 28283
2013-10-31 18:41:02,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=null
2013-10-31 18:41:02,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51159, bytes: 28507, op: HDFS_READ, cliID: DFSClient_1275874167, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 398172
2013-10-31 18:41:02,929 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_1804964651075253424_1290 to 127.0.0.1:34578 
2013-10-31 18:41:02,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data6/current/blk_-4010317939662345352 for deletion
2013-10-31 18:41:02,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data5/current/blk_-235108636050631590 for deletion
2013-10-31 18:41:02,929 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295024924997773881_1284 file build/test/data/dfs/data/data5/current/blk_295024924997773881 for deletion
2013-10-31 18:41:02,930 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5626442093913306657_1281 file build/test/data/dfs/data/data6/current/blk_5626442093913306657 for deletion
2013-10-31 18:41:02,930 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0029: nMaps=4 nReduces=1 max=-1
2013-10-31 18:41:02,930 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data5/current/blk_-235108636050631590
2013-10-31 18:41:02,930 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0029
2013-10-31 18:41:02,930 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0029 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:41:02,930 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295024924997773881_1284 at file build/test/data/dfs/data/data5/current/blk_295024924997773881
2013-10-31 18:41:02,930 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data6/current/blk_-4010317939662345352
2013-10-31 18:41:02,931 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_1804964651075253424_1290 to /127.0.0.1:34578
2013-10-31 18:41:02,930 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0029	RESULT=SUCCESS
2013-10-31 18:41:02,930 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0029
2013-10-31 18:41:02,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:51160 dest: /127.0.0.1:34578
2013-10-31 18:41:02,931 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5626442093913306657_1281 at file build/test/data/dfs/data/data6/current/blk_5626442093913306657
2013-10-31 18:41:02,932 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0029
2013-10-31 18:41:02,933 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1804964651075253424_1290 src: /127.0.0.1:51160 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:41:02,936 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:02,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,950 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml. blk_-3916428015842641732_1295
2013-10-31 18:41:02,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3916428015842641732_1295 src: /127.0.0.1:48249 dest: /127.0.0.1:37740
2013-10-31 18:41:02,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3916428015842641732_1295 src: /127.0.0.1:51162 dest: /127.0.0.1:34578
2013-10-31 18:41:02,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3916428015842641732_1295 src: /127.0.0.1:44360 dest: /127.0.0.1:59471
2013-10-31 18:41:02,956 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44360, dest: /127.0.0.1:59471, bytes: 28348, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3916428015842641732_1295, duration: 2043794
2013-10-31 18:41:02,957 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3916428015842641732_1295 terminating
2013-10-31 18:41:02,957 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51162, dest: /127.0.0.1:34578, bytes: 28348, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3916428015842641732_1295, duration: 1107174
2013-10-31 18:41:02,957 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3916428015842641732_1295 terminating
2013-10-31 18:41:02,957 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48249, dest: /127.0.0.1:37740, bytes: 28348, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3916428015842641732_1295, duration: 2473471
2013-10-31 18:41:02,957 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3916428015842641732_1295 terminating
2013-10-31 18:41:02,960 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3916428015842641732_1295 size 28348
2013-10-31 18:41:02,960 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml from client DFSClient_1275874167
2013-10-31 18:41:02,960 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml is closed by DFSClient_1275874167
2013-10-31 18:41:02,961 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3916428015842641732_1295 size 28348
2013-10-31 18:41:02,961 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3916428015842641732_1295 size 28348
2013-10-31 18:41:02,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,976 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken. blk_8785549613552392148_1296
2013-10-31 18:41:02,977 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8785549613552392148_1296 src: /127.0.0.1:44361 dest: /127.0.0.1:59471
2013-10-31 18:41:02,979 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8785549613552392148_1296 src: /127.0.0.1:48536 dest: /127.0.0.1:54365
2013-10-31 18:41:02,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8785549613552392148_1296 src: /127.0.0.1:48254 dest: /127.0.0.1:37740
2013-10-31 18:41:02,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48254, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8785549613552392148_1296, duration: 68599
2013-10-31 18:41:02,984 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8785549613552392148_1296 terminating
2013-10-31 18:41:02,984 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48536, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8785549613552392148_1296, duration: 872934
2013-10-31 18:41:02,985 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8785549613552392148_1296 terminating
2013-10-31 18:41:02,985 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44361, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8785549613552392148_1296, duration: 1833765
2013-10-31 18:41:02,986 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8785549613552392148_1296 terminating
2013-10-31 18:41:02,989 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8785549613552392148_1296 size 116
2013-10-31 18:41:02,990 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken from client DFSClient_-1596270109
2013-10-31 18:41:02,990 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:41:02,990 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8785549613552392148_1296 size 116
2013-10-31 18:41:02,991 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8785549613552392148_1296 size 116
2013-10-31 18:41:03,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295024924997773881_1284 file build/test/data/dfs/data/data2/current/blk_295024924997773881 for deletion
2013-10-31 18:41:03,326 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295024924997773881_1284 at file build/test/data/dfs/data/data2/current/blk_295024924997773881
2013-10-31 18:41:03,520 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken
2013-10-31 18:41:03,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:41:03,525 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44364, bytes: 157, op: HDFS_READ, cliID: DFSClient_1275874167, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1212781167072705890_1292, duration: 284578
2013-10-31 18:41:03,526 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0029 = 815. Number of splits = 4
2013-10-31 18:41:03,526 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,529 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,529 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,529 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0029 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:41:03,530 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0029 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:41:03,804 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0029_m_000005_0' to tip task_20131031182606197_0029_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:03,811 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000000_0'
2013-10-31 18:41:03,811 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000005_0'
2013-10-31 18:41:03,814 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:41:03,814 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000001_0'
2013-10-31 18:41:03,815 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000005_0 which needs 1 slots
2013-10-31 18:41:03,815 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000005_0 which needs 1 slots
2013-10-31 18:41:03,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken	dst=null	perm=null
2013-10-31 18:41:03,823 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48256, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8785549613552392148_1296, duration: 305137
2013-10-31 18:41:03,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=null
2013-10-31 18:41:03,833 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48541, bytes: 28507, op: HDFS_READ, cliID: DFSClient_1704203369, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_243604678923041825_1293, duration: 389766
2013-10-31 18:41:03,838 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000002_0'
2013-10-31 18:41:03,860 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:03,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=null
2013-10-31 18:41:03,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48259, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1704203369, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1804964651075253424_1290, duration: 1471266
2013-10-31 18:41:03,987 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0028_m_474040702
2013-10-31 18:41:03,995 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32565 with signal TERM. Exit code 0
2013-10-31 18:41:03,995 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_1993047584
2013-10-31 18:41:03,995 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_1993047584 spawned.
2013-10-31 18:41:03,999 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000005_0/taskjvm.sh
2013-10-31 18:41:04,214 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:04,215 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:04,215 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:04,215 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_474040702 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:04,538 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_5626442093913306657_1281 blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_295024924997773881_1284 blk_-2267545822353736092_1280
2013-10-31 18:41:04,983 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_1993047584 given task: attempt_20131031182606197_0029_m_000005_0
2013-10-31 18:41:05,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:05,992 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:05,993 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000004_0 not found in cache
2013-10-31 18:41:05,993 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000003_0 not found in cache
2013-10-31 18:41:05,994 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331265994
2013-10-31 18:41:06,400 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data8/current/blk_-4010317939662345352 for deletion
2013-10-31 18:41:06,400 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2267545822353736092_1280 file build/test/data/dfs/data/data8/current/blk_-2267545822353736092 for deletion
2013-10-31 18:41:06,400 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data7/current/blk_-235108636050631590 for deletion
2013-10-31 18:41:06,401 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data8/current/blk_-4010317939662345352
2013-10-31 18:41:06,401 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295024924997773881_1284 file build/test/data/dfs/data/data7/current/blk_295024924997773881 for deletion
2013-10-31 18:41:06,401 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2267545822353736092_1280 at file build/test/data/dfs/data/data8/current/blk_-2267545822353736092
2013-10-31 18:41:06,401 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5626442093913306657_1281 file build/test/data/dfs/data/data7/current/blk_5626442093913306657 for deletion
2013-10-31 18:41:06,401 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data7/current/blk_-235108636050631590
2013-10-31 18:41:06,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295024924997773881_1284 at file build/test/data/dfs/data/data7/current/blk_295024924997773881
2013-10-31 18:41:06,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5626442093913306657_1281 at file build/test/data/dfs/data/data7/current/blk_5626442093913306657
2013-10-31 18:41:06,643 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-2144061624 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:06,654 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32676 with signal TERM. Exit code 0
2013-10-31 18:41:06,845 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:06,845 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:06,845 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:06,846 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-2144061624 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:07,458 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-1006496814 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:07,468 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group436 with signal TERM. Exit code 0
2013-10-31 18:41:07,647 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:07,648 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:07,648 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:07,648 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-1006496814 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:08,431 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000005_0 0.0% setup
2013-10-31 18:41:08,433 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000005_0 is done.
2013-10-31 18:41:08,434 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000005_0  was -1
2013-10-31 18:41:08,434 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:08,815 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:08,815 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000000_0 not found in cache
2013-10-31 18:41:08,815 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:08,816 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000001_0 not found in cache
2013-10-31 18:41:08,816 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331268816
2013-10-31 18:41:08,816 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331268816
2013-10-31 18:41:08,839 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:08,840 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000002_0 not found in cache
2013-10-31 18:41:08,840 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331268840
2013-10-31 18:41:09,122 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-284700878 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:09,132 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32443 with signal TERM. Exit code 0
2013-10-31 18:41:09,417 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:09,417 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:09,417 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:09,417 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-284700878 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:09,533 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-475802321 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:09,544 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32639 with signal TERM. Exit code 0
2013-10-31 18:41:09,574 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-1504316073 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:09,582 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32677 with signal TERM. Exit code 0
2013-10-31 18:41:09,750 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:09,750 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:09,750 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:09,750 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-475802321 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:09,756 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:09,756 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:09,757 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:09,757 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-1504316073 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:09,819 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000005_0' has completed task_20131031182606197_0029_m_000005 successfully.
2013-10-31 18:41:09,822 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000000_0' to tip task_20131031182606197_0029_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:09,823 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000000
2013-10-31 18:41:09,824 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000001_0' to tip task_20131031182606197_0029_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:41:09,824 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000001
2013-10-31 18:41:09,825 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:09,825 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000000_0 which needs 1 slots
2013-10-31 18:41:09,825 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000000_0 which needs 1 slots
2013-10-31 18:41:09,826 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:41:09,826 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000001_0 which needs 1 slots
2013-10-31 18:41:09,827 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000001_0 which needs 1 slots
2013-10-31 18:41:09,831 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:41:09,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken	dst=null	perm=null
2013-10-31 18:41:09,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44371, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8785549613552392148_1296, duration: 145993
2013-10-31 18:41:09,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=null
2013-10-31 18:41:09,843 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48264, bytes: 28507, op: HDFS_READ, cliID: DFSClient_-1474656826, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_243604678923041825_1293, duration: 215670
2013-10-31 18:41:09,844 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000002_0' to tip task_20131031182606197_0029_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:41:09,844 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000002
2013-10-31 18:41:09,852 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:41:09,852 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000002_0 which needs 1 slots
2013-10-31 18:41:09,852 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000002_0 which needs 1 slots
2013-10-31 18:41:09,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken	dst=null	perm=null
2013-10-31 18:41:09,858 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44374, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8785549613552392148_1296, duration: 307036
2013-10-31 18:41:09,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=null
2013-10-31 18:41:09,864 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51179, bytes: 28507, op: HDFS_READ, cliID: DFSClient_-446861028, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 182515
2013-10-31 18:41:09,864 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:09,871 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_1939526561
2013-10-31 18:41:09,872 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_1939526561 spawned.
2013-10-31 18:41:09,874 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000000_0/taskjvm.sh
2013-10-31 18:41:09,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=null
2013-10-31 18:41:09,886 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48268, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1474656826, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1804964651075253424_1290, duration: 851526
2013-10-31 18:41:09,949 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_-1898251875
2013-10-31 18:41:09,950 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_-1898251875 spawned.
2013-10-31 18:41:09,951 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000001_0/taskjvm.sh
2013-10-31 18:41:09,982 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:10,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=null
2013-10-31 18:41:10,002 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000003_0' to tip task_20131031182606197_0029_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:41:10,003 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000003
2013-10-31 18:41:10,004 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:41:10,005 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000003_0 which needs 1 slots
2013-10-31 18:41:10,005 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000003_0 which needs 1 slots
2013-10-31 18:41:10,007 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48552, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-446861028, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1804964651075253424_1290, duration: 1775973
2013-10-31 18:41:10,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken	dst=null	perm=null
2013-10-31 18:41:10,011 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48553, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8785549613552392148_1296, duration: 144693
2013-10-31 18:41:10,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml	dst=null	perm=null
2013-10-31 18:41:10,020 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51184, bytes: 28507, op: HDFS_READ, cliID: DFSClient_1761917186, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 158296
2013-10-31 18:41:10,038 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:10,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar	dst=null	perm=null
2013-10-31 18:41:10,052 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51185, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1761917186, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1804964651075253424_1290, duration: 596392
2013-10-31 18:41:10,307 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_-1471644336
2013-10-31 18:41:10,308 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_-1471644336 spawned.
2013-10-31 18:41:10,308 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_-512352330
2013-10-31 18:41:10,309 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_-512352330 spawned.
2013-10-31 18:41:10,309 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000002_0/taskjvm.sh
2013-10-31 18:41:10,310 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000003_0/taskjvm.sh
2013-10-31 18:41:10,837 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_1939526561 given task: attempt_20131031182606197_0029_m_000000_0
2013-10-31 18:41:11,144 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_-1898251875 given task: attempt_20131031182606197_0029_m_000001_0
2013-10-31 18:41:11,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=null
2013-10-31 18:41:11,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48277, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2443861200343278733_1291, duration: 176015
2013-10-31 18:41:11,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000	dst=null	perm=null
2013-10-31 18:41:11,381 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51190, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6468364575429809189_1285, duration: 125115
2013-10-31 18:41:11,599 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_-1471644336 given task: attempt_20131031182606197_0029_m_000002_0
2013-10-31 18:41:11,605 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_-512352330 given task: attempt_20131031182606197_0029_m_000003_0
2013-10-31 18:41:11,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=null
2013-10-31 18:41:11,645 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44391, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2443861200343278733_1291, duration: 169898
2013-10-31 18:41:11,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003	dst=null	perm=null
2013-10-31 18:41:11,684 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48566, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1964692028297874732_1288, duration: 142287
2013-10-31 18:41:12,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=null
2013-10-31 18:41:12,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44395, bytes: 883, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2443861200343278733_1291, duration: 163331
2013-10-31 18:41:12,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split	dst=null	perm=null
2013-10-31 18:41:12,116 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51199, bytes: 367, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2443861200343278733_1291, duration: 120595
2013-10-31 18:41:12,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001	dst=null	perm=null
2013-10-31 18:41:12,136 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48571, bytes: 221, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4446515941025710904_1288, duration: 108699
2013-10-31 18:41:12,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002	dst=null	perm=null
2013-10-31 18:41:12,152 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48289, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1749832804603777904_1288, duration: 111309
2013-10-31 18:41:14,263 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000:0+264
2013-10-31 18:41:14,266 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000000_0 is done.
2013-10-31 18:41:14,266 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000000_0  was 196
2013-10-31 18:41:14,267 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:14,574 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003:0+264
2013-10-31 18:41:14,576 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000001_0 is done.
2013-10-31 18:41:14,577 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000001_0  was 196
2013-10-31 18:41:14,577 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:14,825 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0029_m_000005_0
2013-10-31 18:41:14,825 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0029_m_000005_0
2013-10-31 18:41:14,826 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0029_m_000005_0 not found in cache
2013-10-31 18:41:15,024 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001:0+217
2013-10-31 18:41:15,027 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000002_0 is done.
2013-10-31 18:41:15,027 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000002_0  was 149
2013-10-31 18:41:15,027 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:15,048 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002:0+70
2013-10-31 18:41:15,050 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000003_0 is done.
2013-10-31 18:41:15,050 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000003_0  was 6
2013-10-31 18:41:15,050 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:15,831 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000000_0' has completed task_20131031182606197_0029_m_000000 successfully.
2013-10-31 18:41:15,833 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0029_r_000000_0' to tip task_20131031182606197_0029_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:15,834 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000001_0' has completed task_20131031182606197_0029_m_000001 successfully.
2013-10-31 18:41:15,835 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:15,836 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_r_000000_0 which needs 1 slots
2013-10-31 18:41:15,836 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_r_000000_0 which needs 1 slots
2013-10-31 18:41:15,854 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000002_0' has completed task_20131031182606197_0029_m_000002 successfully.
2013-10-31 18:41:15,873 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_r_1027368877
2013-10-31 18:41:15,874 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_r_1027368877 spawned.
2013-10-31 18:41:15,876 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_r_000000_0/taskjvm.sh
2013-10-31 18:41:16,003 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 19
2013-10-31 18:41:16,010 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000003_0' has completed task_20131031182606197_0029_m_000003 successfully.
2013-10-31 18:41:16,833 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_r_1027368877 given task: attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:22,501 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42607, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000000_0, duration: 5825534
2013-10-31 18:41:22,516 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45284, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000001_0, duration: 8828885
2013-10-31 18:41:22,534 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50243, bytes: 149, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000002_0, duration: 11613521
2013-10-31 18:41:22,551 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40589, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000003_0, duration: 12253620
2013-10-31 18:41:23,315 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:23,375 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:23,426 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:23,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:23,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:23,653 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000. blk_4451671807219443706_1297
2013-10-31 18:41:23,695 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4451671807219443706_1297 src: /127.0.0.1:48297 dest: /127.0.0.1:37740
2013-10-31 18:41:23,696 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4451671807219443706_1297 src: /127.0.0.1:44407 dest: /127.0.0.1:59471
2013-10-31 18:41:23,697 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4451671807219443706_1297 src: /127.0.0.1:48582 dest: /127.0.0.1:54365
2013-10-31 18:41:23,701 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48582, dest: /127.0.0.1:54365, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0029_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4451671807219443706_1297, duration: 2769818
2013-10-31 18:41:23,701 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4451671807219443706_1297 terminating
2013-10-31 18:41:23,701 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44407, dest: /127.0.0.1:59471, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0029_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4451671807219443706_1297, duration: 3163948
2013-10-31 18:41:23,701 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4451671807219443706_1297 terminating
2013-10-31 18:41:23,702 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48297, dest: /127.0.0.1:37740, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0029_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4451671807219443706_1297, duration: 3530635
2013-10-31 18:41:23,702 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4451671807219443706_1297 terminating
2013-10-31 18:41:23,705 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4451671807219443706_1297 size 495
2013-10-31 18:41:23,705 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4451671807219443706_1297 size 495
2013-10-31 18:41:23,705 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:23,705 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:23,706 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4451671807219443706_1297 size 495
2013-10-31 18:41:23,741 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0029_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:41:23,741 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:24,845 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0029_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:41:24,846 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:25,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0	dst=null	perm=null
2013-10-31 18:41:25,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:25,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:25,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0	dst=null	perm=null
2013-10-31 18:41:26,368 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:26,370 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:26,371 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_r_000000_0 is done.
2013-10-31 18:41:26,371 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_r_000000_0  was -1
2013-10-31 18:41:26,372 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:27,850 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_r_000000_0' has completed task_20131031182606197_0029_r_000000 successfully.
2013-10-31 18:41:27,853 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0029_m_000004_0' to tip task_20131031182606197_0029_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:27,855 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:41:27,855 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000004_0 which needs 1 slots
2013-10-31 18:41:27,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000004_0 which needs 1 slots
2013-10-31 18:41:27,892 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0029/attempt_20131031182606197_0029_m_000004_0. Attempting to reuse: jvm_20131031182606197_0029_m_1993047584
2013-10-31 18:41:28,520 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_1993047584 given task: attempt_20131031182606197_0029_m_000004_0
2013-10-31 18:41:28,638 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000004_0 0.0% 
2013-10-31 18:41:28,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary	dst=null	perm=null
2013-10-31 18:41:28,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:28,659 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_SUCCESS from client DFSClient_attempt_20131031182606197_0029_m_000004_0
2013-10-31 18:41:28,659 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0029_m_000004_0
2013-10-31 18:41:28,663 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:28,663 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,663 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1212781167072705890 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1212781167072705890 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1212781167072705890 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_243604678923041825 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_243604678923041825 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_243604678923041825 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029	dst=null	perm=null
2013-10-31 18:41:31,542 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-2443861200343278733_1291 blk_-1212781167072705890_1292 blk_1804964651075253424_1290 blk_243604678923041825_1293
2013-10-31 18:41:31,543 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-2443861200343278733_1291 blk_1804964651075253424_1290 blk_243604678923041825_1293
2013-10-31 18:41:31,607 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000004_0 0.0% cleanup
2013-10-31 18:41:31,609 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000004_0 is done.
2013-10-31 18:41:31,609 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000004_0  was -1
2013-10-31 18:41:31,609 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:32,856 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:32,856 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:33,336 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data2/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:33,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1212781167072705890_1292 file build/test/data/dfs/data/data1/current/blk_-1212781167072705890 for deletion
2013-10-31 18:41:33,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data2/current/blk_-2443861200343278733
2013-10-31 18:41:33,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1212781167072705890_1292 at file build/test/data/dfs/data/data1/current/blk_-1212781167072705890
2013-10-31 18:41:33,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_243604678923041825_1293 file build/test/data/dfs/data/data2/current/blk_243604678923041825 for deletion
2013-10-31 18:41:33,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_243604678923041825_1293 at file build/test/data/dfs/data/data2/current/blk_243604678923041825
2013-10-31 18:41:33,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data1/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:33,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data1/current/blk_1804964651075253424
2013-10-31 18:41:33,408 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data8/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:33,409 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_243604678923041825_1293 file build/test/data/dfs/data/data7/current/blk_243604678923041825 for deletion
2013-10-31 18:41:33,409 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data8/current/blk_-2443861200343278733
2013-10-31 18:41:33,409 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data7/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:33,409 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_243604678923041825_1293 at file build/test/data/dfs/data/data7/current/blk_243604678923041825
2013-10-31 18:41:33,410 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data7/current/blk_1804964651075253424
2013-10-31 18:41:33,863 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000004_0' has completed task_20131031182606197_0029_m_000004 successfully.
2013-10-31 18:41:33,864 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0029 has completed successfully.
2013-10-31 18:41:33,865 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0029,submitTime=1383244862902,launchTime=1383244863529,firstMapTaskLaunchTime=1383244869822,firstReduceTaskLaunchTime=1383244875832,firstJobSetupTaskLaunchTime=1383244863804,firstJobCleanupTaskLaunchTime=1383244887852,finishTime=1383244893864,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=26,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[AA2052F0D79D45CC875DDB141C76CED5/106D7E74095247668E8A8F32E6B51F99] merged/(2/2) ...splitsourcemergedsamename
2013-10-31 18:41:33,871 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766. blk_800740813804517052_1298
2013-10-31 18:41:33,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_800740813804517052_1298 src: /127.0.0.1:51217 dest: /127.0.0.1:34578
2013-10-31 18:41:33,882 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_800740813804517052_1298 src: /127.0.0.1:48306 dest: /127.0.0.1:37740
2013-10-31 18:41:33,884 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_800740813804517052_1298 src: /127.0.0.1:48590 dest: /127.0.0.1:54365
2013-10-31 18:41:33,893 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48590, dest: /127.0.0.1:54365, bytes: 27806, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_800740813804517052_1298, duration: 5540407
2013-10-31 18:41:33,893 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_800740813804517052_1298 terminating
2013-10-31 18:41:33,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48306, dest: /127.0.0.1:37740, bytes: 27806, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_800740813804517052_1298, duration: 5403742
2013-10-31 18:41:33,894 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_800740813804517052_1298 terminating
2013-10-31 18:41:33,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51217, dest: /127.0.0.1:34578, bytes: 27806, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_800740813804517052_1298, duration: 7241652
2013-10-31 18:41:33,896 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_800740813804517052_1298 terminating
2013-10-31 18:41:33,901 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_800740813804517052_1298 size 27806
2013-10-31 18:41:33,903 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 from client DFSClient_1275874167
2013-10-31 18:41:33,904 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 is closed by DFSClient_1275874167
2013-10-31 18:41:33,904 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_800740813804517052_1298 size 27806
2013-10-31 18:41:33,904 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_800740813804517052_1298 size 27806
2013-10-31 18:41:33,911 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:33,912 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000000_0'
2013-10-31 18:41:33,912 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000004_0'
2013-10-31 18:41:33,913 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000005_0'
2013-10-31 18:41:33,913 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_r_000000_0'
2013-10-31 18:41:33,914 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8785549613552392148 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,914 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8785549613552392148 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,914 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000002_0'
2013-10-31 18:41:33,914 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8785549613552392148 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,915 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000001_0'
2013-10-31 18:41:33,917 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0029_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:33,921 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6893710486870095770 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,921 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6893710486870095770 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,922 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6893710486870095770 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,922 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-566339595978537805 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,922 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-566339595978537805 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029	dst=null	perm=null
2013-10-31 18:41:33,922 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-566339595978537805 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6468364575429809189 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6468364575429809189 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6468364575429809189 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,923 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4446515941025710904 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,924 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4446515941025710904 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,924 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4446515941025710904 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,924 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1749832804603777904 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,924 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1749832804603777904 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,925 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1749832804603777904 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,925 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1964692028297874732 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,925 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1964692028297874732 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,925 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1964692028297874732 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75	dst=null	perm=null
2013-10-31 18:41:33,931 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary
2013-10-31 18:41:33,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename	dst=null	perm=null
2013-10-31 18:41:33,951 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:33,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000	dst=null	perm=null
2013-10-31 18:41:33,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000	dst=null	perm=null
2013-10-31 18:41:33,954 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48592, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4451671807219443706_1297, duration: 127438
2013-10-31 18:41:33,954 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitsourcemergedsamename
2013-10-31 18:41:33,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename	dst=null	perm=null
2013-10-31 18:41:33,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000	dst=null	perm=null
2013-10-31 18:41:33,960 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44419, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4451671807219443706_1297, duration: 288340
2013-10-31 18:41:33,970 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:41:33,970 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:41:33,990 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] starting
2013-10-31 18:41:33,991 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 18:41:33,991 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper]  source: Hfs["TextDelimited[['num', 'char']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:41:33,991 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic"]
2013-10-31 18:41:33,991 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper]  parallel execution is enabled: true
2013-10-31 18:41:33,991 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper]  starting jobs: 1
2013-10-31 18:41:33,991 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper]  allocating threads: 1
2013-10-31 18:41:33,992 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper] starting step: (1/1) ...grouping-nondeterministic
2013-10-31 18:41:33,994 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:41:33,994 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:41:33,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:34,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:41:34,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,007 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar. blk_-3274370513633766733_1299
2013-10-31 18:41:34,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:44420 dest: /127.0.0.1:59471
2013-10-31 18:41:34,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:48312 dest: /127.0.0.1:37740
2013-10-31 18:41:34,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:51225 dest: /127.0.0.1:34578
2013-10-31 18:41:34,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51225, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3274370513633766733_1299, duration: 3793639
2013-10-31 18:41:34,017 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3274370513633766733_1299 terminating
2013-10-31 18:41:34,017 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48312, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3274370513633766733_1299, duration: 4491690
2013-10-31 18:41:34,017 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3274370513633766733_1299 terminating
2013-10-31 18:41:34,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44420, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3274370513633766733_1299, duration: 5064586
2013-10-31 18:41:34,018 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:34,019 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3274370513633766733_1299 terminating
2013-10-31 18:41:34,021 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:34,022 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar from client DFSClient_-1596270109
2013-10-31 18:41:34,022 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:41:34,022 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:34,027 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar. New replication is 10
2013-10-31 18:41:34,028 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000003_0'
2013-10-31 18:41:34,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar	dst=null	perm=null
2013-10-31 18:41:34,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,285 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:41:34,290 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:41:34,293 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:41:34,296 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:41:34,299 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:41:34,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,317 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split. New replication is 10
2013-10-31 18:41:34,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:34,325 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split. blk_5598164801874600176_1300
2013-10-31 18:41:34,326 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:51226 dest: /127.0.0.1:34578
2013-10-31 18:41:34,328 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:48315 dest: /127.0.0.1:37740
2013-10-31 18:41:34,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:44425 dest: /127.0.0.1:59471
2013-10-31 18:41:34,331 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:48600 dest: /127.0.0.1:54365
2013-10-31 18:41:34,335 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48600, dest: /127.0.0.1:54365, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5598164801874600176_1300, duration: 111187
2013-10-31 18:41:34,335 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44425, dest: /127.0.0.1:59471, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 1059072
2013-10-31 18:41:34,336 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48315, dest: /127.0.0.1:37740, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5598164801874600176_1300, duration: 2131796
2013-10-31 18:41:34,337 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,337 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51226, dest: /127.0.0.1:34578, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5598164801874600176_1300, duration: 2926185
2013-10-31 18:41:34,338 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,343 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,343 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split from client DFSClient_-1596270109
2013-10-31 18:41:34,344 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split is closed by DFSClient_-1596270109
2013-10-31 18:41:34,344 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,345 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,377 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo. blk_-3493737347595243725_1301
2013-10-31 18:41:34,378 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3493737347595243725_1301 src: /127.0.0.1:48601 dest: /127.0.0.1:54365
2013-10-31 18:41:34,380 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3493737347595243725_1301 src: /127.0.0.1:48319 dest: /127.0.0.1:37740
2013-10-31 18:41:34,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3493737347595243725_1301 src: /127.0.0.1:44429 dest: /127.0.0.1:59471
2013-10-31 18:41:34,384 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44429, dest: /127.0.0.1:59471, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3493737347595243725_1301, duration: 67413
2013-10-31 18:41:34,385 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3493737347595243725_1301 terminating
2013-10-31 18:41:34,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48319, dest: /127.0.0.1:37740, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3493737347595243725_1301, duration: 864233
2013-10-31 18:41:34,386 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3493737347595243725_1301 terminating
2013-10-31 18:41:34,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48601, dest: /127.0.0.1:54365, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3493737347595243725_1301, duration: 1782963
2013-10-31 18:41:34,387 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3493737347595243725_1301 terminating
2013-10-31 18:41:34,388 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3493737347595243725_1301 size 218
2013-10-31 18:41:34,390 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3493737347595243725_1301 size 218
2013-10-31 18:41:34,390 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:41:34,391 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:41:34,391 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3493737347595243725_1301 size 218
2013-10-31 18:41:34,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,417 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml. blk_-8056076980841541999_1302
2013-10-31 18:41:34,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8056076980841541999_1302 src: /127.0.0.1:48321 dest: /127.0.0.1:37740
2013-10-31 18:41:34,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8056076980841541999_1302 src: /127.0.0.1:48605 dest: /127.0.0.1:54365
2013-10-31 18:41:34,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8056076980841541999_1302 src: /127.0.0.1:51235 dest: /127.0.0.1:34578
2013-10-31 18:41:34,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51235, dest: /127.0.0.1:34578, bytes: 29470, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8056076980841541999_1302, duration: 328818
2013-10-31 18:41:34,425 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8056076980841541999_1302 terminating
2013-10-31 18:41:34,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48605, dest: /127.0.0.1:54365, bytes: 29470, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8056076980841541999_1302, duration: 1169381
2013-10-31 18:41:34,426 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8056076980841541999_1302 terminating
2013-10-31 18:41:34,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48321, dest: /127.0.0.1:37740, bytes: 29470, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8056076980841541999_1302, duration: 2092939
2013-10-31 18:41:34,427 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8056076980841541999_1302 terminating
2013-10-31 18:41:34,428 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8056076980841541999_1302 size 29470
2013-10-31 18:41:34,429 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml from client DFSClient_-1596270109
2013-10-31 18:41:34,429 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:41:34,429 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8056076980841541999_1302 size 29470
2013-10-31 18:41:34,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8056076980841541999_1302 size 29470
2013-10-31 18:41:34,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml	dst=null	perm=null
2013-10-31 18:41:34,449 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48325, bytes: 29702, op: HDFS_READ, cliID: DFSClient_-624635407, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8056076980841541999_1302, duration: 465383
2013-10-31 18:41:34,467 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0030: nMaps=6 nReduces=1 max=-1
2013-10-31 18:41:34,468 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0030 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:41:34,468 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0030
2013-10-31 18:41:34,468 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0030	RESULT=SUCCESS
2013-10-31 18:41:34,468 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0030
2013-10-31 18:41:34,469 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper] submitted hadoop job: job_20131031182606197_0030
2013-10-31 18:41:34,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,497 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml. blk_5829088887948398201_1304
2013-10-31 18:41:34,498 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829088887948398201_1304 src: /127.0.0.1:48609 dest: /127.0.0.1:54365
2013-10-31 18:41:34,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829088887948398201_1304 src: /127.0.0.1:51239 dest: /127.0.0.1:34578
2013-10-31 18:41:34,502 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829088887948398201_1304 src: /127.0.0.1:48328 dest: /127.0.0.1:37740
2013-10-31 18:41:34,506 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48328, dest: /127.0.0.1:37740, bytes: 29535, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5829088887948398201_1304, duration: 485642
2013-10-31 18:41:34,506 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5829088887948398201_1304 terminating
2013-10-31 18:41:34,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51239, dest: /127.0.0.1:34578, bytes: 29535, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5829088887948398201_1304, duration: 1267326
2013-10-31 18:41:34,507 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5829088887948398201_1304 terminating
2013-10-31 18:41:34,507 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5829088887948398201_1304 size 29535
2013-10-31 18:41:34,508 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48609, dest: /127.0.0.1:54365, bytes: 29535, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5829088887948398201_1304, duration: 2209178
2013-10-31 18:41:34,508 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5829088887948398201_1304 terminating
2013-10-31 18:41:34,510 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml from client DFSClient_-624635407
2013-10-31 18:41:34,511 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml is closed by DFSClient_-624635407
2013-10-31 18:41:34,511 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5829088887948398201_1304 size 29535
2013-10-31 18:41:34,512 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5829088887948398201_1304 size 29535
2013-10-31 18:41:34,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,522 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken. blk_-2628080352316033489_1305
2013-10-31 18:41:34,524 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2628080352316033489_1305 src: /127.0.0.1:48329 dest: /127.0.0.1:37740
2013-10-31 18:41:34,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2628080352316033489_1305 src: /127.0.0.1:48613 dest: /127.0.0.1:54365
2013-10-31 18:41:34,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2628080352316033489_1305 src: /127.0.0.1:44440 dest: /127.0.0.1:59471
2013-10-31 18:41:34,530 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44440, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2628080352316033489_1305, duration: 1062166
2013-10-31 18:41:34,530 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2628080352316033489_1305 terminating
2013-10-31 18:41:34,530 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48613, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2628080352316033489_1305, duration: 1690427
2013-10-31 18:41:34,531 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2628080352316033489_1305 terminating
2013-10-31 18:41:34,531 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48329, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2628080352316033489_1305, duration: 2154121
2013-10-31 18:41:34,532 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2628080352316033489_1305 terminating
2013-10-31 18:41:34,533 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2628080352316033489_1305 size 116
2013-10-31 18:41:34,534 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken from client DFSClient_-1596270109
2013-10-31 18:41:34,534 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:41:34,535 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2628080352316033489_1305 size 116
2013-10-31 18:41:34,536 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2628080352316033489_1305 size 116
2013-10-31 18:41:34,544 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-3274370513633766733_1299 to datanode(s) 127.0.0.1:54365
2013-10-31 18:41:34,544 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_1749832804603777904_1288 blk_-4446515941025710904_1288 blk_6468364575429809189_1285 blk_-2443861200343278733_1291 blk_-1212781167072705890_1292 blk_1964692028297874732_1288 blk_1804964651075253424_1290 blk_8785549613552392148_1296
2013-10-31 18:41:34,545 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-566339595978537805_1283 blk_6893710486870095770_1289 blk_-4446515941025710904_1288 blk_6468364575429809189_1285 blk_-2443861200343278733_1291 blk_-1212781167072705890_1292 blk_1964692028297874732_1288 blk_1804964651075253424_1290 blk_243604678923041825_1293 blk_8785549613552392148_1296
2013-10-31 18:41:34,771 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken
2013-10-31 18:41:34,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:41:34,775 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48615, bytes: 222, op: HDFS_READ, cliID: DFSClient_-624635407, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3493737347595243725_1301, duration: 280578
2013-10-31 18:41:34,776 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0030 = 38. Number of splits = 6
2013-10-31 18:41:34,777 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,777 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,777 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,777 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,781 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0030 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:41:34,782 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0030 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:41:35,211 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4446515941025710904_1288 file build/test/data/dfs/data/data4/current/blk_-4446515941025710904 for deletion
2013-10-31 18:41:35,211 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data4/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:35,211 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4446515941025710904_1288 at file build/test/data/dfs/data/data4/current/blk_-4446515941025710904
2013-10-31 18:41:35,211 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1212781167072705890_1292 file build/test/data/dfs/data/data3/current/blk_-1212781167072705890 for deletion
2013-10-31 18:41:35,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data4/current/blk_-2443861200343278733
2013-10-31 18:41:35,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-566339595978537805_1283 file build/test/data/dfs/data/data4/current/blk_-566339595978537805 for deletion
2013-10-31 18:41:35,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1212781167072705890_1292 at file build/test/data/dfs/data/data3/current/blk_-1212781167072705890
2013-10-31 18:41:35,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-566339595978537805_1283 at file build/test/data/dfs/data/data4/current/blk_-566339595978537805
2013-10-31 18:41:35,212 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_243604678923041825_1293 file build/test/data/dfs/data/data4/current/blk_243604678923041825 for deletion
2013-10-31 18:41:35,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data3/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:35,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_243604678923041825_1293 at file build/test/data/dfs/data/data4/current/blk_243604678923041825
2013-10-31 18:41:35,213 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1964692028297874732_1288 file build/test/data/dfs/data/data3/current/blk_1964692028297874732 for deletion
2013-10-31 18:41:35,214 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data3/current/blk_1804964651075253424
2013-10-31 18:41:35,214 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6468364575429809189_1285 file build/test/data/dfs/data/data3/current/blk_6468364575429809189 for deletion
2013-10-31 18:41:35,214 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1964692028297874732_1288 at file build/test/data/dfs/data/data3/current/blk_1964692028297874732
2013-10-31 18:41:35,214 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6893710486870095770_1289 file build/test/data/dfs/data/data4/current/blk_6893710486870095770 for deletion
2013-10-31 18:41:35,214 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6468364575429809189_1285 at file build/test/data/dfs/data/data3/current/blk_6468364575429809189
2013-10-31 18:41:35,215 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6893710486870095770_1289 at file build/test/data/dfs/data/data4/current/blk_6893710486870095770
2013-10-31 18:41:35,215 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8785549613552392148_1296 file build/test/data/dfs/data/data3/current/blk_8785549613552392148 for deletion
2013-10-31 18:41:35,215 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8785549613552392148_1296 at file build/test/data/dfs/data/data3/current/blk_8785549613552392148
2013-10-31 18:41:35,456 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_800740813804517052_1298
2013-10-31 18:41:35,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4446515941025710904_1288 file build/test/data/dfs/data/data6/current/blk_-4446515941025710904 for deletion
2013-10-31 18:41:35,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data5/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:35,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4446515941025710904_1288 at file build/test/data/dfs/data/data6/current/blk_-4446515941025710904
2013-10-31 18:41:35,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1212781167072705890_1292 file build/test/data/dfs/data/data6/current/blk_-1212781167072705890 for deletion
2013-10-31 18:41:35,940 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data5/current/blk_-2443861200343278733
2013-10-31 18:41:35,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1212781167072705890_1292 at file build/test/data/dfs/data/data6/current/blk_-1212781167072705890
2013-10-31 18:41:35,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1749832804603777904_1288 file build/test/data/dfs/data/data5/current/blk_1749832804603777904 for deletion
2013-10-31 18:41:35,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data6/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:35,941 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1749832804603777904_1288 at file build/test/data/dfs/data/data5/current/blk_1749832804603777904
2013-10-31 18:41:35,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1964692028297874732_1288 file build/test/data/dfs/data/data5/current/blk_1964692028297874732 for deletion
2013-10-31 18:41:35,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data6/current/blk_1804964651075253424
2013-10-31 18:41:35,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6468364575429809189_1285 file build/test/data/dfs/data/data6/current/blk_6468364575429809189 for deletion
2013-10-31 18:41:35,942 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1964692028297874732_1288 at file build/test/data/dfs/data/data5/current/blk_1964692028297874732
2013-10-31 18:41:35,943 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6468364575429809189_1285 at file build/test/data/dfs/data/data6/current/blk_6468364575429809189
2013-10-31 18:41:35,943 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8785549613552392148_1296 file build/test/data/dfs/data/data6/current/blk_8785549613552392148 for deletion
2013-10-31 18:41:35,943 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8785549613552392148_1296 at file build/test/data/dfs/data/data6/current/blk_8785549613552392148
2013-10-31 18:41:36,337 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-3274370513633766733_1299 to 127.0.0.1:54365 
2013-10-31 18:41:36,339 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:48616 dest: /127.0.0.1:54365
2013-10-31 18:41:36,339 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-3274370513633766733_1299 to /127.0.0.1:54365
2013-10-31 18:41:36,343 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3274370513633766733_1299 src: /127.0.0.1:48616 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:41:36,345 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:36,919 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0030_m_000007_0' to tip task_20131031182606197_0030_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:36,930 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:41:36,930 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000007_0 which needs 1 slots
2013-10-31 18:41:36,930 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000007_0 which needs 1 slots
2013-10-31 18:41:36,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken	dst=null	perm=null
2013-10-31 18:41:36,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48617, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2628080352316033489_1305, duration: 306931
2013-10-31 18:41:36,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml	dst=null	perm=null
2013-10-31 18:41:36,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48336, bytes: 29702, op: HDFS_READ, cliID: DFSClient_-547219168, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8056076980841541999_1302, duration: 431355
2013-10-31 18:41:36,979 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:37,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar	dst=null	perm=null
2013-10-31 18:41:37,004 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44446, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-547219168, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3274370513633766733_1299, duration: 1232680
2013-10-31 18:41:37,098 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0029_m_1939526561
2013-10-31 18:41:37,104 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group754 with signal TERM. Exit code 0
2013-10-31 18:41:37,105 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_1591829464
2013-10-31 18:41:37,105 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_1591829464 spawned.
2013-10-31 18:41:37,107 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000007_0/taskjvm.sh
2013-10-31 18:41:37,373 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:37,373 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:37,373 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:37,374 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_1939526561 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:37,545 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1749832804603777904_1288 blk_-566339595978537805_1283 blk_6893710486870095770_1289 blk_-4446515941025710904_1288 blk_6468364575429809189_1285 blk_1964692028297874732_1288
2013-10-31 18:41:37,546 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_1749832804603777904_1288 blk_-566339595978537805_1283 blk_6893710486870095770_1289 blk_8785549613552392148_1296
2013-10-31 18:41:38,080 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_1591829464 given task: attempt_20131031182606197_0030_m_000007_0
2013-10-31 18:41:38,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:38,915 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:38,915 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0029_m_000004_0 not found in cache
2013-10-31 18:41:38,915 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:38,916 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331298916
2013-10-31 18:41:38,916 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:38,917 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331298917
2013-10-31 18:41:38,917 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331298917
2013-10-31 18:41:39,030 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:39,031 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331299030
2013-10-31 18:41:39,153 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_-1898251875 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,164 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group820 with signal TERM. Exit code 0
2013-10-31 18:41:39,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4446515941025710904_1288 file build/test/data/dfs/data/data1/current/blk_-4446515941025710904 for deletion
2013-10-31 18:41:39,337 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-566339595978537805_1283 file build/test/data/dfs/data/data1/current/blk_-566339595978537805 for deletion
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4446515941025710904_1288 at file build/test/data/dfs/data/data1/current/blk_-4446515941025710904
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1749832804603777904_1288 file build/test/data/dfs/data/data2/current/blk_1749832804603777904 for deletion
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-566339595978537805_1283 at file build/test/data/dfs/data/data1/current/blk_-566339595978537805
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1964692028297874732_1288 file build/test/data/dfs/data/data2/current/blk_1964692028297874732 for deletion
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1749832804603777904_1288 at file build/test/data/dfs/data/data2/current/blk_1749832804603777904
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6468364575429809189_1285 file build/test/data/dfs/data/data1/current/blk_6468364575429809189 for deletion
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1964692028297874732_1288 at file build/test/data/dfs/data/data2/current/blk_1964692028297874732
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6893710486870095770_1289 file build/test/data/dfs/data/data1/current/blk_6893710486870095770 for deletion
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6468364575429809189_1285 at file build/test/data/dfs/data/data1/current/blk_6468364575429809189
2013-10-31 18:41:39,338 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6893710486870095770_1289 at file build/test/data/dfs/data/data1/current/blk_6893710486870095770
2013-10-31 18:41:39,393 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,393 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,393 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:39,394 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_-1898251875 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:39,411 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-566339595978537805_1283 file build/test/data/dfs/data/data8/current/blk_-566339595978537805 for deletion
2013-10-31 18:41:39,411 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1749832804603777904_1288 file build/test/data/dfs/data/data7/current/blk_1749832804603777904 for deletion
2013-10-31 18:41:39,411 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-566339595978537805_1283 at file build/test/data/dfs/data/data8/current/blk_-566339595978537805
2013-10-31 18:41:39,411 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6893710486870095770_1289 file build/test/data/dfs/data/data8/current/blk_6893710486870095770 for deletion
2013-10-31 18:41:39,412 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1749832804603777904_1288 at file build/test/data/dfs/data/data7/current/blk_1749832804603777904
2013-10-31 18:41:39,412 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6893710486870095770_1289 at file build/test/data/dfs/data/data8/current/blk_6893710486870095770
2013-10-31 18:41:39,412 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8785549613552392148_1296 file build/test/data/dfs/data/data7/current/blk_8785549613552392148 for deletion
2013-10-31 18:41:39,413 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8785549613552392148_1296 at file build/test/data/dfs/data/data7/current/blk_8785549613552392148
2013-10-31 18:41:39,608 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_-1471644336 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,617 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_-512352330 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,619 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group857 with signal TERM. Exit code 0
2013-10-31 18:41:39,626 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group858 with signal TERM. Exit code 0
2013-10-31 18:41:39,646 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_1993047584 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,653 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group588 with signal TERM. Exit code 0
2013-10-31 18:41:39,816 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,816 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,816 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:39,816 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_1993047584 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:41:39,835 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,835 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,835 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:39,835 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_-1471644336 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:39,856 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,856 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,856 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:39,856 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_-512352330 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:40,411 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_r_1027368877 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:40,423 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1033 with signal TERM. Exit code 0
2013-10-31 18:41:40,611 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:40,611 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:40,611 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:41:40,611 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_r_1027368877 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:41,526 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000007_0 0.0% setup
2013-10-31 18:41:41,528 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000007_0 is done.
2013-10-31 18:41:41,529 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000007_0  was -1
2013-10-31 18:41:41,529 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:42,936 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000007_0' has completed task_20131031182606197_0030_m_000007 successfully.
2013-10-31 18:41:42,940 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000000_0' to tip task_20131031182606197_0030_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:42,941 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000000
2013-10-31 18:41:42,941 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000001_0' to tip task_20131031182606197_0030_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:42,942 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000001
2013-10-31 18:41:42,944 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000002_0' to tip task_20131031182606197_0030_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:41:42,945 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:42,945 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000002
2013-10-31 18:41:42,946 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:41:42,946 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000003_0' to tip task_20131031182606197_0030_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:41:42,946 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000000_0 which needs 1 slots
2013-10-31 18:41:42,947 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000000_0 which needs 1 slots
2013-10-31 18:41:42,947 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000003
2013-10-31 18:41:42,947 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000001_0 which needs 1 slots
2013-10-31 18:41:42,948 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0030_m_000001_0 which needs 1 slots
2013-10-31 18:41:42,952 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:41:42,954 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:41:42,955 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000002_0 which needs 1 slots
2013-10-31 18:41:42,955 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000002_0 which needs 1 slots
2013-10-31 18:41:42,955 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000003_0 which needs 1 slots
2013-10-31 18:41:42,956 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0030_m_000003_0 which needs 1 slots
2013-10-31 18:41:42,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken	dst=null	perm=null
2013-10-31 18:41:42,964 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48340, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2628080352316033489_1305, duration: 293202
2013-10-31 18:41:42,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml	dst=null	perm=null
2013-10-31 18:41:42,976 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000004_0' to tip task_20131031182606197_0030_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:41:42,976 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48625, bytes: 29702, op: HDFS_READ, cliID: DFSClient_35762182, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8056076980841541999_1302, duration: 567113
2013-10-31 18:41:42,977 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000004
2013-10-31 18:41:42,977 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000005_0' to tip task_20131031182606197_0030_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:41:42,978 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000005
2013-10-31 18:41:42,980 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:41:42,981 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:41:42,982 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000004_0 which needs 1 slots
2013-10-31 18:41:42,982 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000004_0 which needs 1 slots
2013-10-31 18:41:42,982 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000005_0 which needs 1 slots
2013-10-31 18:41:42,983 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0030_m_000005_0 which needs 1 slots
2013-10-31 18:41:42,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken	dst=null	perm=null
2013-10-31 18:41:42,992 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48626, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2628080352316033489_1305, duration: 266111
2013-10-31 18:41:42,993 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_-230758348
2013-10-31 18:41:42,994 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_-230758348 spawned.
2013-10-31 18:41:42,996 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0030/attempt_20131031182606197_0030_m_000001_0. Attempting to reuse: jvm_20131031182606197_0030_m_1591829464
2013-10-31 18:41:42,998 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000000_0/taskjvm.sh
2013-10-31 18:41:43,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml	dst=null	perm=null
2013-10-31 18:41:43,004 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51257, bytes: 29702, op: HDFS_READ, cliID: DFSClient_-319392861, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8056076980841541999_1302, duration: 181494
2013-10-31 18:41:43,033 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:43,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar	dst=null	perm=null
2013-10-31 18:41:43,062 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51258, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-319392861, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3274370513633766733_1299, duration: 1232161
2013-10-31 18:41:43,076 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:43,084 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_1591829464 given task: attempt_20131031182606197_0030_m_000001_0
2013-10-31 18:41:43,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar	dst=null	perm=null
2013-10-31 18:41:43,103 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48347, bytes: 239915, op: HDFS_READ, cliID: DFSClient_35762182, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3274370513633766733_1299, duration: 1285929
2013-10-31 18:41:43,139 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_585283222
2013-10-31 18:41:43,140 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_585283222 spawned.
2013-10-31 18:41:43,140 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_-1072137497
2013-10-31 18:41:43,141 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_-1072137497 spawned.
2013-10-31 18:41:43,142 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000005_0/taskjvm.sh
2013-10-31 18:41:43,142 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000004_0/taskjvm.sh
2013-10-31 18:41:43,164 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_237536229
2013-10-31 18:41:43,164 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_237536229 spawned.
2013-10-31 18:41:43,164 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_926338037
2013-10-31 18:41:43,166 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_926338037 spawned.
2013-10-31 18:41:43,166 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000003_0/taskjvm.sh
2013-10-31 18:41:43,167 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000002_0/taskjvm.sh
2013-10-31 18:41:43,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:43,783 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44460, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 375429
2013-10-31 18:41:43,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:41:43,823 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51264, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 109853
2013-10-31 18:41:44,245 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_-230758348 given task: attempt_20131031182606197_0030_m_000000_0
2013-10-31 18:41:44,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:44,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51266, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5598164801874600176_1300, duration: 170875
2013-10-31 18:41:44,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:41:45,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48359, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 141420
2013-10-31 18:41:45,225 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_-1072137497 given task: attempt_20131031182606197_0030_m_000004_0
2013-10-31 18:41:45,239 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_585283222 given task: attempt_20131031182606197_0030_m_000005_0
2013-10-31 18:41:45,259 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_926338037 given task: attempt_20131031182606197_0030_m_000002_0
2013-10-31 18:41:45,266 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_237536229 given task: attempt_20131031182606197_0030_m_000003_0
2013-10-31 18:41:45,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:45,745 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44473, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000004_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 173604
2013-10-31 18:41:45,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:45,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:45,769 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44474, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 160880
2013-10-31 18:41:45,773 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51278, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000005_0, offset: 1536, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5598164801874600176_1300, duration: 156962
2013-10-31 18:41:45,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split	dst=null	perm=null
2013-10-31 18:41:45,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:41:45,791 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51279, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000004_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 172000
2013-10-31 18:41:45,794 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48368, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5598164801874600176_1300, duration: 158884
2013-10-31 18:41:45,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:41:45,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:41:45,813 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48652, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000005_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 118785
2013-10-31 18:41:45,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:41:45,835 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48653, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 134733
2013-10-31 18:41:46,060 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44480, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 138649
2013-10-31 18:41:46,745 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:41:46,748 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000001_0 is done.
2013-10-31 18:41:46,748 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000001_0  was 40
2013-10-31 18:41:46,748 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:41:47,759 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:41:47,762 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000000_0 is done.
2013-10-31 18:41:47,762 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000000_0  was 57
2013-10-31 18:41:47,763 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:47,947 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0030_m_000007_0
2013-10-31 18:41:47,947 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0030_m_000007_0
2013-10-31 18:41:47,947 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0030_m_000007_0 not found in cache
2013-10-31 18:41:48,670 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:41:48,672 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000004_0 is done.
2013-10-31 18:41:48,673 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000004_0  was 6
2013-10-31 18:41:48,673 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:41:48,688 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000005_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:41:48,690 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000005_0 is done.
2013-10-31 18:41:48,690 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000005_0  was 6
2013-10-31 18:41:48,690 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:48,693 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:41:48,694 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000002_0 is done.
2013-10-31 18:41:48,695 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000002_0  was 57
2013-10-31 18:41:48,695 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:41:48,721 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:41:48,722 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000003_0 is done.
2013-10-31 18:41:48,722 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000003_0  was 40
2013-10-31 18:41:48,723 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:48,950 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000000_0' has completed task_20131031182606197_0030_m_000000 successfully.
2013-10-31 18:41:48,952 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000001_0' has completed task_20131031182606197_0030_m_000001 successfully.
2013-10-31 18:41:48,954 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0030_r_000000_0' to tip task_20131031182606197_0030_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:48,956 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:48,956 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_r_000000_0 which needs 1 slots
2013-10-31 18:41:48,956 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000002_0' has completed task_20131031182606197_0030_m_000002 successfully.
2013-10-31 18:41:48,957 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_r_000000_0 which needs 1 slots
2013-10-31 18:41:48,958 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000003_0' has completed task_20131031182606197_0030_m_000003 successfully.
2013-10-31 18:41:48,984 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000004_0' has completed task_20131031182606197_0030_m_000004 successfully.
2013-10-31 18:41:48,985 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000005_0' has completed task_20131031182606197_0030_m_000005 successfully.
2013-10-31 18:41:48,992 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_r_-2128071556
2013-10-31 18:41:48,993 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_r_-2128071556 spawned.
2013-10-31 18:41:48,994 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_r_000000_0/taskjvm.sh
2013-10-31 18:41:50,130 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_r_-2128071556 given task: attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:55,825 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42689, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000000_0, duration: 8655027
2013-10-31 18:41:55,843 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42689, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000001_0, duration: 10482318
2013-10-31 18:41:55,860 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50324, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000002_0, duration: 11894283
2013-10-31 18:41:55,875 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50324, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000003_0, duration: 11502776
2013-10-31 18:41:55,892 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45367, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000004_0, duration: 11793621
2013-10-31 18:41:55,907 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45367, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000005_0, duration: 11290458
2013-10-31 18:41:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:41:56,015 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,020 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,025 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,031 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,036 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,041 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,041 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:41:56,623 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:56,699 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:56,780 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:56,986 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1600 Total time for transactions(ms): 32Number of transactions batched in Syncs: 134 Number of syncs: 1120 SyncTimes(ms): 72542 16302 
2013-10-31 18:41:56,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:57,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:57,028 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000. blk_-1943840392902481091_1306
2013-10-31 18:41:57,063 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1943840392902481091_1306 src: /127.0.0.1:48378 dest: /127.0.0.1:37740
2013-10-31 18:41:57,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1943840392902481091_1306 src: /127.0.0.1:48662 dest: /127.0.0.1:54365
2013-10-31 18:41:57,066 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1943840392902481091_1306 src: /127.0.0.1:51292 dest: /127.0.0.1:34578
2013-10-31 18:41:57,070 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51292, dest: /127.0.0.1:34578, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0030_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1943840392902481091_1306, duration: 1492839
2013-10-31 18:41:57,071 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1943840392902481091_1306 terminating
2013-10-31 18:41:57,071 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48662, dest: /127.0.0.1:54365, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0030_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1943840392902481091_1306, duration: 3261206
2013-10-31 18:41:57,072 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1943840392902481091_1306 terminating
2013-10-31 18:41:57,072 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1943840392902481091_1306 size 20
2013-10-31 18:41:57,072 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48378, dest: /127.0.0.1:37740, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0030_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1943840392902481091_1306, duration: 5038260
2013-10-31 18:41:57,073 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1943840392902481091_1306 terminating
2013-10-31 18:41:57,073 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1943840392902481091_1306 size 20
2013-10-31 18:41:57,075 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:57,076 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:57,076 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1943840392902481091_1306 size 20
2013-10-31 18:41:57,111 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0030_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:41:57,111 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:57,966 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   6 OK for attempt_20131031182606197_0030_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:41:57,967 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:58,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0	dst=null	perm=null
2013-10-31 18:41:58,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:58,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:58,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0	dst=null	perm=null
2013-10-31 18:41:59,672 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:59,675 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:59,676 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_r_000000_0 is done.
2013-10-31 18:41:59,676 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_r_000000_0  was -1
2013-10-31 18:41:59,676 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:00,970 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_r_000000_0' has completed task_20131031182606197_0030_r_000000 successfully.
2013-10-31 18:42:00,987 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0030_m_000006_0' to tip task_20131031182606197_0030_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:00,990 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:42:00,991 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000006_0 which needs 1 slots
2013-10-31 18:42:00,991 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000006_0 which needs 1 slots
2013-10-31 18:42:01,030 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0030/attempt_20131031182606197_0030_m_000006_0. Attempting to reuse: jvm_20131031182606197_0030_m_1591829464
2013-10-31 18:42:02,294 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_1591829464 given task: attempt_20131031182606197_0030_m_000006_0
2013-10-31 18:42:02,424 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000006_0 0.0% 
2013-10-31 18:42:02,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary	dst=null	perm=null
2013-10-31 18:42:02,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:02,443 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_SUCCESS from client DFSClient_attempt_20131031182606197_0030_m_000006_0
2013-10-31 18:42:02,444 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0030_m_000006_0
2013-10-31 18:42:02,448 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3493737347595243725 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3493737347595243725 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3493737347595243725 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8056076980841541999 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:02,449 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8056076980841541999 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,450 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8056076980841541999 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030	dst=null	perm=null
2013-10-31 18:42:04,550 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-3274370513633766733_1299 blk_-8056076980841541999_1302 blk_5598164801874600176_1300
2013-10-31 18:42:04,550 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-3493737347595243725_1301 blk_-3274370513633766733_1299 blk_-8056076980841541999_1302 blk_5598164801874600176_1300
2013-10-31 18:42:05,398 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000006_0 0.0% cleanup
2013-10-31 18:42:05,399 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000006_0 is done.
2013-10-31 18:42:05,399 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000006_0  was -1
2013-10-31 18:42:05,400 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:05,991 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:42:05,991 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:42:06,347 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8056076980841541999_1302 file build/test/data/dfs/data/data2/current/blk_-8056076980841541999 for deletion
2013-10-31 18:42:06,347 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data2/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:06,347 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8056076980841541999_1302 at file build/test/data/dfs/data/data2/current/blk_-8056076980841541999
2013-10-31 18:42:06,347 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data1/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:06,348 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data2/current/blk_-3274370513633766733
2013-10-31 18:42:06,348 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data1/current/blk_5598164801874600176
2013-10-31 18:42:06,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8056076980841541999_1302 file build/test/data/dfs/data/data7/current/blk_-8056076980841541999 for deletion
2013-10-31 18:42:06,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3493737347595243725_1301 file build/test/data/dfs/data/data8/current/blk_-3493737347595243725 for deletion
2013-10-31 18:42:06,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8056076980841541999_1302 at file build/test/data/dfs/data/data7/current/blk_-8056076980841541999
2013-10-31 18:42:06,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data8/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:06,420 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3493737347595243725_1301 at file build/test/data/dfs/data/data8/current/blk_-3493737347595243725
2013-10-31 18:42:06,421 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data7/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:06,421 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data8/current/blk_-3274370513633766733
2013-10-31 18:42:06,421 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data7/current/blk_5598164801874600176
2013-10-31 18:42:06,998 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000006_0' has completed task_20131031182606197_0030_m_000006 successfully.
2013-10-31 18:42:06,999 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0030 has completed successfully.
2013-10-31 18:42:06,999 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0030,submitTime=1383244894435,launchTime=1383244894781,firstMapTaskLaunchTime=1383244902940,firstReduceTaskLaunchTime=1383244908953,firstJobSetupTaskLaunchTime=1383244896919,firstJobCleanupTaskLaunchTime=1383244920987,finishTime=1383244926999,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7EE435642A834BB9AD13D3AF2B9F9FA1/9123A166C26B48BF9A23CF9D5EF2DE87] lower+upper/(1/1) ...grouping-nondeterministic
2013-10-31 18:42:07,004 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF. blk_5752235491390791018_1307
2013-10-31 18:42:07,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5752235491390791018_1307 src: /127.0.0.1:44492 dest: /127.0.0.1:59471
2013-10-31 18:42:07,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5752235491390791018_1307 src: /127.0.0.1:48667 dest: /127.0.0.1:54365
2013-10-31 18:42:07,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5752235491390791018_1307 src: /127.0.0.1:48385 dest: /127.0.0.1:37740
2013-10-31 18:42:07,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48385, dest: /127.0.0.1:37740, bytes: 34976, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5752235491390791018_1307, duration: 2360591
2013-10-31 18:42:07,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5752235491390791018_1307 terminating
2013-10-31 18:42:07,017 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48667, dest: /127.0.0.1:54365, bytes: 34976, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5752235491390791018_1307, duration: 3629289
2013-10-31 18:42:07,017 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5752235491390791018_1307 terminating
2013-10-31 18:42:07,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44492, dest: /127.0.0.1:59471, bytes: 34976, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5752235491390791018_1307, duration: 4458269
2013-10-31 18:42:07,018 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5752235491390791018_1307 size 34976
2013-10-31 18:42:07,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5752235491390791018_1307 terminating
2013-10-31 18:42:07,021 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5752235491390791018_1307 size 34976
2013-10-31 18:42:07,022 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF from client DFSClient_-624635407
2013-10-31 18:42:07,023 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF is closed by DFSClient_-624635407
2013-10-31 18:42:07,023 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5752235491390791018_1307 size 34976
2013-10-31 18:42:07,031 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:07,032 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000000_0'
2013-10-31 18:42:07,032 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000001_0'
2013-10-31 18:42:07,032 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000006_0'
2013-10-31 18:42:07,032 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000007_0'
2013-10-31 18:42:07,033 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2628080352316033489 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:07,033 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_r_000000_0'
2013-10-31 18:42:07,034 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2628080352316033489 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:07,034 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2628080352316033489 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:07,035 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000002_0'
2013-10-31 18:42:07,035 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000003_0'
2013-10-31 18:42:07,035 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000004_0'
2013-10-31 18:42:07,036 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000005_0'
2013-10-31 18:42:07,041 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary
2013-10-31 18:42:07,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic	dst=null	perm=null
2013-10-31 18:42:07,061 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:42:07,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000	dst=null	perm=null
2013-10-31 18:42:07,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000	dst=null	perm=null
2013-10-31 18:42:07,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48387, bytes: 24, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1943840392902481091_1306, duration: 277421
2013-10-31 18:42:07,067 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic
2013-10-31 18:42:07,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic	dst=null	perm=null
2013-10-31 18:42:07,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000	dst=null	perm=null
2013-10-31 18:42:07,099 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:07,099 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0030 being deleted.
2013-10-31 18:42:07,551 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-3493737347595243725_1301 blk_-3274370513633766733_1299 blk_-2628080352316033489_1305 blk_5598164801874600176_1300
2013-10-31 18:42:07,551 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-3493737347595243725_1301 blk_-3274370513633766733_1299 blk_-2628080352316033489_1305 blk_-8056076980841541999_1302 blk_5598164801874600176_1300
2013-10-31 18:42:07,615 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48388, bytes: 24, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1943840392902481091_1306, duration: 351356
2013-10-31 18:42:07,632 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:42:07,632 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:42:07,641 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:42:07,641 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt"]
2013-10-31 18:42:07,642 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon"]
2013-10-31 18:42:07,642 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:42:07,642 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:42:07,643 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:42:07,643 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pesplatform/ungroupedanon
2013-10-31 18:42:07,646 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:42:07,646 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:42:08,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8056076980841541999_1302 file build/test/data/dfs/data/data4/current/blk_-8056076980841541999 for deletion
2013-10-31 18:42:08,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3493737347595243725_1301 file build/test/data/dfs/data/data3/current/blk_-3493737347595243725 for deletion
2013-10-31 18:42:08,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8056076980841541999_1302 at file build/test/data/dfs/data/data4/current/blk_-8056076980841541999
2013-10-31 18:42:08,222 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data3/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:08,223 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3493737347595243725_1301 at file build/test/data/dfs/data/data3/current/blk_-3493737347595243725
2013-10-31 18:42:08,223 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2628080352316033489_1305 file build/test/data/dfs/data/data4/current/blk_-2628080352316033489 for deletion
2013-10-31 18:42:08,223 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data4/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:08,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2628080352316033489_1305 at file build/test/data/dfs/data/data4/current/blk_-2628080352316033489
2013-10-31 18:42:08,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data4/current/blk_5598164801874600176
2013-10-31 18:42:08,454 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data3/current/blk_-3274370513633766733
2013-10-31 18:42:08,457 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0030_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:08,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030	dst=null	perm=null
2013-10-31 18:42:08,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:08,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:42:08,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,520 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar. blk_3405378349805446451_1308
2013-10-31 18:42:08,522 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:48672 dest: /127.0.0.1:54365
2013-10-31 18:42:08,524 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:51302 dest: /127.0.0.1:34578
2013-10-31 18:42:08,526 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:44500 dest: /127.0.0.1:59471
2013-10-31 18:42:08,536 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44500, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3405378349805446451_1308, duration: 6629327
2013-10-31 18:42:08,536 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3405378349805446451_1308 terminating
2013-10-31 18:42:08,537 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51302, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3405378349805446451_1308, duration: 7439483
2013-10-31 18:42:08,538 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3405378349805446451_1308 terminating
2013-10-31 18:42:08,538 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48672, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3405378349805446451_1308, duration: 8657758
2013-10-31 18:42:08,539 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3405378349805446451_1308 terminating
2013-10-31 18:42:08,540 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:08,541 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar from client DFSClient_-1596270109
2013-10-31 18:42:08,541 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:42:08,542 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:08,542 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:08,547 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar. New replication is 10
2013-10-31 18:42:08,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar	dst=null	perm=null
2013-10-31 18:42:08,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,938 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:42:08,942 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:42:08,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:42:08,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,951 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3493737347595243725_1301 file build/test/data/dfs/data/data6/current/blk_-3493737347595243725 for deletion
2013-10-31 18:42:08,952 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data6/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:08,952 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3493737347595243725_1301 at file build/test/data/dfs/data/data6/current/blk_-3493737347595243725
2013-10-31 18:42:08,952 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2628080352316033489_1305 file build/test/data/dfs/data/data5/current/blk_-2628080352316033489 for deletion
2013-10-31 18:42:08,952 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data6/current/blk_-3274370513633766733
2013-10-31 18:42:08,953 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2628080352316033489_1305 at file build/test/data/dfs/data/data5/current/blk_-2628080352316033489
2013-10-31 18:42:08,953 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data5/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:08,953 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data5/current/blk_5598164801874600176
2013-10-31 18:42:08,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,956 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split. New replication is 10
2013-10-31 18:42:08,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=null
2013-10-31 18:42:08,963 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split. blk_-3576267029470916644_1309
2013-10-31 18:42:08,964 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:48392 dest: /127.0.0.1:37740
2013-10-31 18:42:08,966 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:51305 dest: /127.0.0.1:34578
2013-10-31 18:42:08,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:48677 dest: /127.0.0.1:54365
2013-10-31 18:42:08,969 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:44504 dest: /127.0.0.1:59471
2013-10-31 18:42:08,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44504, dest: /127.0.0.1:59471, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3576267029470916644_1309, duration: 88363
2013-10-31 18:42:08,973 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48677, dest: /127.0.0.1:54365, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 907013
2013-10-31 18:42:08,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51305, dest: /127.0.0.1:34578, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3576267029470916644_1309, duration: 1705510
2013-10-31 18:42:08,975 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,975 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,975 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48392, dest: /127.0.0.1:37740, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3576267029470916644_1309, duration: 2661925
2013-10-31 18:42:08,976 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,979 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,979 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split from client DFSClient_-1596270109
2013-10-31 18:42:08,980 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split is closed by DFSClient_-1596270109
2013-10-31 18:42:08,980 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,981 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,999 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo. blk_2501650952349019281_1310
2013-10-31 18:42:09,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2501650952349019281_1310 src: /127.0.0.1:51308 dest: /127.0.0.1:34578
2013-10-31 18:42:09,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2501650952349019281_1310 src: /127.0.0.1:44506 dest: /127.0.0.1:59471
2013-10-31 18:42:09,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2501650952349019281_1310 src: /127.0.0.1:48681 dest: /127.0.0.1:54365
2013-10-31 18:42:09,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48681, dest: /127.0.0.1:54365, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2501650952349019281_1310, duration: 66043
2013-10-31 18:42:09,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2501650952349019281_1310 terminating
2013-10-31 18:42:09,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44506, dest: /127.0.0.1:59471, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2501650952349019281_1310, duration: 866783
2013-10-31 18:42:09,009 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2501650952349019281_1310 terminating
2013-10-31 18:42:09,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51308, dest: /127.0.0.1:34578, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2501650952349019281_1310, duration: 1933341
2013-10-31 18:42:09,010 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2501650952349019281_1310 terminating
2013-10-31 18:42:09,010 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2501650952349019281_1310 size 183
2013-10-31 18:42:09,013 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:42:09,013 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:42:09,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2501650952349019281_1310 size 183
2013-10-31 18:42:09,014 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2501650952349019281_1310 size 183
2013-10-31 18:42:09,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,036 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml. blk_602449860203028534_1311
2013-10-31 18:42:09,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_602449860203028534_1311 src: /127.0.0.1:48682 dest: /127.0.0.1:54365
2013-10-31 18:42:09,039 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_602449860203028534_1311 src: /127.0.0.1:51312 dest: /127.0.0.1:34578
2013-10-31 18:42:09,041 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_602449860203028534_1311 src: /127.0.0.1:48401 dest: /127.0.0.1:37740
2013-10-31 18:42:09,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48401, dest: /127.0.0.1:37740, bytes: 27576, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_602449860203028534_1311, duration: 288169
2013-10-31 18:42:09,044 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_602449860203028534_1311 terminating
2013-10-31 18:42:09,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51312, dest: /127.0.0.1:34578, bytes: 27576, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_602449860203028534_1311, duration: 1108611
2013-10-31 18:42:09,045 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_602449860203028534_1311 terminating
2013-10-31 18:42:09,045 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_602449860203028534_1311 size 27576
2013-10-31 18:42:09,046 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48682, dest: /127.0.0.1:54365, bytes: 27576, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_602449860203028534_1311, duration: 2015783
2013-10-31 18:42:09,046 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_602449860203028534_1311 size 27576
2013-10-31 18:42:09,046 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_602449860203028534_1311 terminating
2013-10-31 18:42:09,051 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_602449860203028534_1311 size 27576
2013-10-31 18:42:09,052 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml from client DFSClient_-1596270109
2013-10-31 18:42:09,052 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:42:09,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml	dst=null	perm=null
2013-10-31 18:42:09,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51315, bytes: 27792, op: HDFS_READ, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_602449860203028534_1311, duration: 454103
2013-10-31 18:42:09,085 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0031: nMaps=5 nReduces=0 max=-1
2013-10-31 18:42:09,085 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0031 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:42:09,086 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0031
2013-10-31 18:42:09,086 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0031	RESULT=SUCCESS
2013-10-31 18:42:09,086 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0031
2013-10-31 18:42:09,087 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0031
2013-10-31 18:42:09,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,121 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml. blk_-7567248241593720369_1313
2013-10-31 18:42:09,122 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7567248241593720369_1313 src: /127.0.0.1:44513 dest: /127.0.0.1:59471
2013-10-31 18:42:09,124 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7567248241593720369_1313 src: /127.0.0.1:48405 dest: /127.0.0.1:37740
2013-10-31 18:42:09,126 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7567248241593720369_1313 src: /127.0.0.1:51318 dest: /127.0.0.1:34578
2013-10-31 18:42:09,130 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51318, dest: /127.0.0.1:34578, bytes: 27641, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7567248241593720369_1313, duration: 1097875
2013-10-31 18:42:09,131 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7567248241593720369_1313 terminating
2013-10-31 18:42:09,131 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48405, dest: /127.0.0.1:37740, bytes: 27641, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7567248241593720369_1313, duration: 2075935
2013-10-31 18:42:09,132 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7567248241593720369_1313 terminating
2013-10-31 18:42:09,132 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44513, dest: /127.0.0.1:59471, bytes: 27641, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7567248241593720369_1313, duration: 2830701
2013-10-31 18:42:09,133 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7567248241593720369_1313 terminating
2013-10-31 18:42:09,133 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7567248241593720369_1313 size 27641
2013-10-31 18:42:09,135 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml from client DFSClient_-1193761217
2013-10-31 18:42:09,135 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml is closed by DFSClient_-1193761217
2013-10-31 18:42:09,136 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7567248241593720369_1313 size 27641
2013-10-31 18:42:09,136 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7567248241593720369_1313 size 27641
2013-10-31 18:42:09,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,154 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken. blk_4951964880204109736_1314
2013-10-31 18:42:09,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4951964880204109736_1314 src: /127.0.0.1:51319 dest: /127.0.0.1:34578
2013-10-31 18:42:09,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4951964880204109736_1314 src: /127.0.0.1:44517 dest: /127.0.0.1:59471
2013-10-31 18:42:09,159 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4951964880204109736_1314 src: /127.0.0.1:48692 dest: /127.0.0.1:54365
2013-10-31 18:42:09,161 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48692, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4951964880204109736_1314, duration: 1013877
2013-10-31 18:42:09,162 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4951964880204109736_1314 terminating
2013-10-31 18:42:09,162 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44517, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4951964880204109736_1314, duration: 937472
2013-10-31 18:42:09,163 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4951964880204109736_1314 terminating
2013-10-31 18:42:09,163 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51319, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4951964880204109736_1314, duration: 2083688
2013-10-31 18:42:09,164 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4951964880204109736_1314 terminating
2013-10-31 18:42:09,166 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4951964880204109736_1314 size 116
2013-10-31 18:42:09,167 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4951964880204109736_1314 size 116
2013-10-31 18:42:09,167 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4951964880204109736_1314 size 116
2013-10-31 18:42:09,566 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken from client DFSClient_-1596270109
2013-10-31 18:42:09,567 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:42:09,946 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken
2013-10-31 18:42:09,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:42:09,951 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51322, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2501650952349019281_1310, duration: 359306
2013-10-31 18:42:09,952 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0031 = 30. Number of splits = 5
2013-10-31 18:42:09,952 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,956 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0031 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:42:09,957 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0031 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 18:42:10,038 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0031_m_000006_0' to tip task_20131031182606197_0031_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:10,046 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:42:10,047 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000006_0 which needs 1 slots
2013-10-31 18:42:10,047 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000006_0 which needs 1 slots
2013-10-31 18:42:10,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken	dst=null	perm=null
2013-10-31 18:42:10,055 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44520, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4951964880204109736_1314, duration: 289758
2013-10-31 18:42:10,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml	dst=null	perm=null
2013-10-31 18:42:10,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51325, bytes: 27792, op: HDFS_READ, cliID: DFSClient_-1371319316, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_602449860203028534_1311, duration: 376769
2013-10-31 18:42:10,095 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:10,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar	dst=null	perm=null
2013-10-31 18:42:10,124 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44523, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1371319316, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3405378349805446451_1308, duration: 1184457
2013-10-31 18:42:10,217 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0030_m_-230758348
2013-10-31 18:42:10,221 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1424 with signal TERM. Exit code 0
2013-10-31 18:42:10,222 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_1888122456
2013-10-31 18:42:10,227 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_1888122456 spawned.
2013-10-31 18:42:10,228 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000006_0/taskjvm.sh
2013-10-31 18:42:10,552 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_3405378349805446451_1308 to datanode(s) 127.0.0.1:37740
2013-10-31 18:42:10,553 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-2628080352316033489_1305
2013-10-31 18:42:10,673 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:10,673 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:10,673 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:10,673 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_-230758348 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:11,223 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_3405378349805446451_1308 to 127.0.0.1:37740 
2013-10-31 18:42:11,224 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_3405378349805446451_1308 to /127.0.0.1:37740
2013-10-31 18:42:11,224 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:48415 dest: /127.0.0.1:37740
2013-10-31 18:42:11,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3405378349805446451_1308 src: /127.0.0.1:48415 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:42:11,233 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:11,439 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1888122456 given task: attempt_20131031182606197_0031_m_000006_0
2013-10-31 18:42:11,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:12,035 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:12,035 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0030_m_000006_0 not found in cache
2013-10-31 18:42:12,036 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:12,036 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383331332036
2013-10-31 18:42:12,037 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383331332037
2013-10-31 18:42:12,060 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:12,060 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383331332060
2013-10-31 18:42:12,301 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_r_-2128071556 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:12,312 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1755 with signal TERM. Exit code 0
2013-10-31 18:42:12,421 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2628080352316033489_1305 file build/test/data/dfs/data/data7/current/blk_-2628080352316033489 for deletion
2013-10-31 18:42:12,422 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2628080352316033489_1305 at file build/test/data/dfs/data/data7/current/blk_-2628080352316033489
2013-10-31 18:42:12,492 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:12,492 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:12,493 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:12,493 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_r_-2128071556 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,246 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_-1072137497 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,254 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1488 with signal TERM. Exit code 0
2013-10-31 18:42:13,254 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_585283222 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,257 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_926338037 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,265 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1483 with signal TERM. Exit code 0
2013-10-31 18:42:13,267 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1489 with signal TERM. Exit code 0
2013-10-31 18:42:13,290 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_237536229 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,295 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1490 with signal TERM. Exit code 0
2013-10-31 18:42:13,465 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,465 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,465 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:13,465 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_-1072137497 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,481 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,482 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,482 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:13,482 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_926338037 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,490 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,490 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,490 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:13,490 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_585283222 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,498 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,498 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,498 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:13,498 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_237536229 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,506 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_1591829464 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,510 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1248 with signal TERM. Exit code 0
2013-10-31 18:42:13,684 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,684 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,684 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:13,685 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_1591829464 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:42:14,890 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000006_0 0.0% setup
2013-10-31 18:42:14,893 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000006_0 is done.
2013-10-31 18:42:14,893 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000006_0  was -1
2013-10-31 18:42:14,894 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:16,053 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000006_0' has completed task_20131031182606197_0031_m_000006 successfully.
2013-10-31 18:42:16,056 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000000_0' to tip task_20131031182606197_0031_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:16,057 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000000
2013-10-31 18:42:16,058 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000001_0' to tip task_20131031182606197_0031_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:16,058 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000001
2013-10-31 18:42:16,060 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000002_0' to tip task_20131031182606197_0031_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:42:16,061 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:42:16,061 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000002
2013-10-31 18:42:16,062 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:42:16,063 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000003_0' to tip task_20131031182606197_0031_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:42:16,063 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000000_0 which needs 1 slots
2013-10-31 18:42:16,063 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000000_0 which needs 1 slots
2013-10-31 18:42:16,063 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000003
2013-10-31 18:42:16,064 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000001_0 which needs 1 slots
2013-10-31 18:42:16,064 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0031_m_000001_0 which needs 1 slots
2013-10-31 18:42:16,070 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:42:16,072 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:42:16,072 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000002_0 which needs 1 slots
2013-10-31 18:42:16,072 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000002_0 which needs 1 slots
2013-10-31 18:42:16,073 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000003_0 which needs 1 slots
2013-10-31 18:42:16,073 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0031_m_000003_0 which needs 1 slots
2013-10-31 18:42:16,073 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000004_0' to tip task_20131031182606197_0031_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:42:16,074 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000004
2013-10-31 18:42:16,077 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:42:16,077 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000004_0 which needs 1 slots
2013-10-31 18:42:16,078 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000004_0 which needs 1 slots
2013-10-31 18:42:16,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken	dst=null	perm=null
2013-10-31 18:42:16,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken	dst=null	perm=null
2013-10-31 18:42:16,083 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51331, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4951964880204109736_1314, duration: 482609
2013-10-31 18:42:16,086 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44529, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4951964880204109736_1314, duration: 314541
2013-10-31 18:42:16,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml	dst=null	perm=null
2013-10-31 18:42:16,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml	dst=null	perm=null
2013-10-31 18:42:16,095 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48423, bytes: 27792, op: HDFS_READ, cliID: DFSClient_-1093947786, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_602449860203028534_1311, duration: 416379
2013-10-31 18:42:16,096 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48707, bytes: 27792, op: HDFS_READ, cliID: DFSClient_1247866216, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_602449860203028534_1311, duration: 162017
2013-10-31 18:42:16,100 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_-1600883262
2013-10-31 18:42:16,101 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_-1600883262 spawned.
2013-10-31 18:42:16,101 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0031/attempt_20131031182606197_0031_m_000000_0. Attempting to reuse: jvm_20131031182606197_0031_m_1888122456
2013-10-31 18:42:16,102 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000001_0/taskjvm.sh
2013-10-31 18:42:16,446 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1888122456 given task: attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:16,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=null
2013-10-31 18:42:16,574 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44535, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3576267029470916644_1309, duration: 168282
2013-10-31 18:42:16,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:42:17,686 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:17,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar	dst=null	perm=null
2013-10-31 18:42:17,718 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48427, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1093947786, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3405378349805446451_1308, duration: 1151717
2013-10-31 18:42:17,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:17,772 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:17,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar	dst=null	perm=null
2013-10-31 18:42:17,813 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48711, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1247866216, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3405378349805446451_1308, duration: 1202694
2013-10-31 18:42:17,935 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_1711463638
2013-10-31 18:42:17,937 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_1711463638 spawned.
2013-10-31 18:42:17,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:17,937 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_-1236212079
2013-10-31 18:42:17,940 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_-1236212079 spawned.
2013-10-31 18:42:17,942 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000002_0/taskjvm.sh
2013-10-31 18:42:17,943 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000003_0/taskjvm.sh
2013-10-31 18:42:17,986 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_1917937103
2013-10-31 18:42:17,987 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_1917937103 spawned.
2013-10-31 18:42:17,988 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000004_0/taskjvm.sh
2013-10-31 18:42:18,741 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_-1600883262 given task: attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:18,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48430, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 139442
2013-10-31 18:42:18,931 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000. blk_1487922476689862061_1315
2013-10-31 18:42:18,948 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1487922476689862061_1315 src: /127.0.0.1:44540 dest: /127.0.0.1:59471
2013-10-31 18:42:18,949 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1487922476689862061_1315 src: /127.0.0.1:48432 dest: /127.0.0.1:37740
2013-10-31 18:42:18,950 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1487922476689862061_1315 src: /127.0.0.1:48716 dest: /127.0.0.1:54365
2013-10-31 18:42:18,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48716, dest: /127.0.0.1:54365, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1487922476689862061_1315, duration: 21664812
2013-10-31 18:42:18,973 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1487922476689862061_1315 terminating
2013-10-31 18:42:18,973 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48432, dest: /127.0.0.1:37740, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1487922476689862061_1315, duration: 22031827
2013-10-31 18:42:18,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1487922476689862061_1315 terminating
2013-10-31 18:42:18,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44540, dest: /127.0.0.1:59471, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1487922476689862061_1315, duration: 22537309
2013-10-31 18:42:18,974 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1487922476689862061_1315 terminating
2013-10-31 18:42:18,974 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1487922476689862061_1315 size 16
2013-10-31 18:42:18,978 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1487922476689862061_1315 size 16
2013-10-31 18:42:18,978 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:18,978 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:18,978 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1487922476689862061_1315 size 16
2013-10-31 18:42:19,020 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:19,020 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000000_0 0.0% 
2013-10-31 18:42:19,062 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:19,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=null
2013-10-31 18:42:19,273 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48718, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 174615
2013-10-31 18:42:19,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:42:19,313 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48719, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-677913094566701302_1219, duration: 129084
2013-10-31 18:42:19,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:19,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:19,504 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001. blk_-3429000233400764538_1316
2013-10-31 18:42:19,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3429000233400764538_1316 src: /127.0.0.1:48723 dest: /127.0.0.1:54365
2013-10-31 18:42:19,529 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3429000233400764538_1316 src: /127.0.0.1:48441 dest: /127.0.0.1:37740
2013-10-31 18:42:19,530 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3429000233400764538_1316 src: /127.0.0.1:51354 dest: /127.0.0.1:34578
2013-10-31 18:42:19,532 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51354, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3429000233400764538_1316, duration: 1230654
2013-10-31 18:42:19,533 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3429000233400764538_1316 terminating
2013-10-31 18:42:19,533 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48441, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3429000233400764538_1316, duration: 1567897
2013-10-31 18:42:19,533 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3429000233400764538_1316 terminating
2013-10-31 18:42:19,533 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48723, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3429000233400764538_1316, duration: 1926770
2013-10-31 18:42:19,533 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3429000233400764538_1316 terminating
2013-10-31 18:42:19,534 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3429000233400764538_1316 size 8
2013-10-31 18:42:19,534 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:19,535 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:19,535 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3429000233400764538_1316 size 8
2013-10-31 18:42:19,537 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3429000233400764538_1316 size 8
2013-10-31 18:42:19,583 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:19,583 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000001_0 0.0% 
2013-10-31 18:42:19,621 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1711463638 given task: attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:19,672 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_-1236212079 given task: attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:19,678 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1917937103 given task: attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:20,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0	dst=null	perm=null
2013-10-31 18:42:20,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0	dst=null	perm=null
2013-10-31 18:42:20,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=null
2013-10-31 18:42:20,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51358, bytes: 1262, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3576267029470916644_1309, duration: 162711
2013-10-31 18:42:20,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=null
2013-10-31 18:42:20,174 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48730, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 141137
2013-10-31 18:42:20,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split	dst=null	perm=null
2013-10-31 18:42:20,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:42:20,185 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48731, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000004_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 143748
2013-10-31 18:42:20,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48449, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 101412
2013-10-31 18:42:20,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:42:20,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48450, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 107424
2013-10-31 18:42:20,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2013-10-31 18:42:20,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,225 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48451, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000004_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 131108
2013-10-31 18:42:20,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,371 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002. blk_7204826124865328506_1319
2013-10-31 18:42:20,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7204826124865328506_1319 src: /127.0.0.1:44561 dest: /127.0.0.1:59471
2013-10-31 18:42:20,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7204826124865328506_1319 src: /127.0.0.1:51365 dest: /127.0.0.1:34578
2013-10-31 18:42:20,396 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003. blk_6738845034354110760_1319
2013-10-31 18:42:20,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7204826124865328506_1319 src: /127.0.0.1:48737 dest: /127.0.0.1:54365
2013-10-31 18:42:20,399 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48737, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7204826124865328506_1319, duration: 1289022
2013-10-31 18:42:20,399 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7204826124865328506_1319 terminating
2013-10-31 18:42:20,399 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7204826124865328506_1319 size 8
2013-10-31 18:42:20,399 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51365, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7204826124865328506_1319, duration: 1550018
2013-10-31 18:42:20,400 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7204826124865328506_1319 terminating
2013-10-31 18:42:20,400 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44561, dest: /127.0.0.1:59471, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7204826124865328506_1319, duration: 2071445
2013-10-31 18:42:20,400 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7204826124865328506_1319 terminating
2013-10-31 18:42:20,401 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:20,401 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:20,401 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7204826124865328506_1319 size 8
2013-10-31 18:42:20,402 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7204826124865328506_1319 size 8
2013-10-31 18:42:20,411 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004 from client DFSClient_attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:20,411 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:20,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6738845034354110760_1319 src: /127.0.0.1:44564 dest: /127.0.0.1:59471
2013-10-31 18:42:20,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6738845034354110760_1319 src: /127.0.0.1:48739 dest: /127.0.0.1:54365
2013-10-31 18:42:20,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6738845034354110760_1319 src: /127.0.0.1:48457 dest: /127.0.0.1:37740
2013-10-31 18:42:20,423 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48457, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6738845034354110760_1319, duration: 1175253
2013-10-31 18:42:20,424 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6738845034354110760_1319 terminating
2013-10-31 18:42:20,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48739, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6738845034354110760_1319, duration: 1421353
2013-10-31 18:42:20,424 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6738845034354110760_1319 terminating
2013-10-31 18:42:20,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44564, dest: /127.0.0.1:59471, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6738845034354110760_1319, duration: 1802429
2013-10-31 18:42:20,424 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6738845034354110760_1319 terminating
2013-10-31 18:42:20,425 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6738845034354110760_1319 size 8
2013-10-31 18:42:20,425 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:20,425 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:20,425 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6738845034354110760_1319 size 8
2013-10-31 18:42:20,427 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6738845034354110760_1319 size 8
2013-10-31 18:42:20,992 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:20,992 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000002_0 0.0% 
2013-10-31 18:42:20,997 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:20,997 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:20,997 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000003_0 0.0% 
2013-10-31 18:42:20,997 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000004_0 0.0% 
2013-10-31 18:42:21,063 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0031_m_000006_0
2013-10-31 18:42:21,063 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0031_m_000006_0
2013-10-31 18:42:21,064 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000006_0 not found in cache
2013-10-31 18:42:22,067 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:22,075 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:22,075 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:22,081 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:22,576 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:42:22,581 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:42:22,582 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000000_0 is done.
2013-10-31 18:42:22,582 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000000_0  was -1
2013-10-31 18:42:22,582 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:42:22,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0	dst=null	perm=null
2013-10-31 18:42:22,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:22,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:22,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0	dst=null	perm=null
2013-10-31 18:42:23,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0	dst=null	perm=null
2013-10-31 18:42:23,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0	dst=null	perm=null
2013-10-31 18:42:23,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:23,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0	dst=null	perm=null
2013-10-31 18:42:23,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:23,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:23,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:23,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:23,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0	dst=null	perm=null
2013-10-31 18:42:23,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:23,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0	dst=null	perm=null
2013-10-31 18:42:23,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0	dst=null	perm=null
2013-10-31 18:42:23,070 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:14+7
2013-10-31 18:42:23,072 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000002_0 is done.
2013-10-31 18:42:23,072 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000002_0  was -1
2013-10-31 18:42:23,072 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:42:23,102 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:21+7
2013-10-31 18:42:23,103 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000003_0 is done.
2013-10-31 18:42:23,103 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000003_0  was -1
2013-10-31 18:42:23,103 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:23,112 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:28+2
2013-10-31 18:42:23,113 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000004_0 is done.
2013-10-31 18:42:23,113 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000004_0  was -1
2013-10-31 18:42:23,113 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:25,071 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000000_0' has completed task_20131031182606197_0031_m_000000 successfully.
2013-10-31 18:42:25,079 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000002_0' has completed task_20131031182606197_0031_m_000002 successfully.
2013-10-31 18:42:25,080 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000003_0' has completed task_20131031182606197_0031_m_000003 successfully.
2013-10-31 18:42:25,084 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000004_0' has completed task_20131031182606197_0031_m_000004 successfully.
2013-10-31 18:42:25,248 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:7+7
2013-10-31 18:42:25,250 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:7+7
2013-10-31 18:42:25,251 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000001_0 is done.
2013-10-31 18:42:25,251 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000001_0  was -1
2013-10-31 18:42:25,252 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:28,077 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000001_0' has completed task_20131031182606197_0031_m_000001 successfully.
2013-10-31 18:42:28,079 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0031_m_000005_0' to tip task_20131031182606197_0031_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:28,082 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:42:28,082 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000005_0 which needs 1 slots
2013-10-31 18:42:28,082 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000005_0 which needs 1 slots
2013-10-31 18:42:28,118 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0031/attempt_20131031182606197_0031_m_000005_0. Attempting to reuse: jvm_20131031182606197_0031_m_-1600883262
2013-10-31 18:42:28,781 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_-1600883262 given task: attempt_20131031182606197_0031_m_000005_0
2013-10-31 18:42:28,931 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000005_0 0.0% 
2013-10-31 18:42:28,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary	dst=null	perm=null
2013-10-31 18:42:28,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:28,944 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_SUCCESS from client DFSClient_attempt_20131031182606197_0031_m_000005_0
2013-10-31 18:42:28,944 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0031_m_000005_0
2013-10-31 18:42:28,948 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:28,948 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2501650952349019281 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2501650952349019281 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2501650952349019281 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_602449860203028534 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_602449860203028534 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:28,950 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_602449860203028534 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031	dst=null	perm=null
2013-10-31 18:42:31,556 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-3576267029470916644_1309 blk_602449860203028534_1311 blk_2501650952349019281_1310 blk_3405378349805446451_1308
2013-10-31 18:42:31,556 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-3576267029470916644_1309 blk_602449860203028534_1311 blk_3405378349805446451_1308
2013-10-31 18:42:31,875 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000005_0 0.0% cleanup
2013-10-31 18:42:31,876 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000005_0 is done.
2013-10-31 18:42:31,877 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000005_0  was -1
2013-10-31 18:42:31,877 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:32,230 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data3/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:32,230 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_602449860203028534_1311 file build/test/data/dfs/data/data3/current/blk_602449860203028534 for deletion
2013-10-31 18:42:32,230 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data3/current/blk_-3576267029470916644
2013-10-31 18:42:32,231 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2501650952349019281_1310 file build/test/data/dfs/data/data4/current/blk_2501650952349019281 for deletion
2013-10-31 18:42:32,231 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_602449860203028534_1311 at file build/test/data/dfs/data/data3/current/blk_602449860203028534
2013-10-31 18:42:32,231 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data4/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:32,231 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2501650952349019281_1310 at file build/test/data/dfs/data/data4/current/blk_2501650952349019281
2013-10-31 18:42:32,232 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data4/current/blk_3405378349805446451
2013-10-31 18:42:33,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data8/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:33,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_602449860203028534_1311 file build/test/data/dfs/data/data7/current/blk_602449860203028534 for deletion
2013-10-31 18:42:33,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data8/current/blk_-3576267029470916644
2013-10-31 18:42:33,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data7/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:33,429 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_602449860203028534_1311 at file build/test/data/dfs/data/data7/current/blk_602449860203028534
2013-10-31 18:42:33,430 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data7/current/blk_3405378349805446451
2013-10-31 18:42:34,089 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000005_0' has completed task_20131031182606197_0031_m_000005 successfully.
2013-10-31 18:42:34,090 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0031 has completed successfully.
2013-10-31 18:42:34,090 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0031,submitTime=1383244929056,launchTime=1383244929956,firstMapTaskLaunchTime=1383244936056,firstJobSetupTaskLaunchTime=1383244930038,firstJobCleanupTaskLaunchTime=1383244948079,finishTime=1383244954090,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[08B8455663C7408F9361A4A94E27F7F0/80E663B36EBD4EAAA8EEE272CFCEEE34] test/(1/1) ...pesplatform/ungroupedanon
2013-10-31 18:42:34,095 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA. blk_6816440197397581714_1320
2013-10-31 18:42:34,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6816440197397581714_1320 src: /127.0.0.1:48464 dest: /127.0.0.1:37740
2013-10-31 18:42:34,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6816440197397581714_1320 src: /127.0.0.1:48748 dest: /127.0.0.1:54365
2013-10-31 18:42:34,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6816440197397581714_1320 src: /127.0.0.1:44575 dest: /127.0.0.1:59471
2013-10-31 18:42:34,111 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44575, dest: /127.0.0.1:59471, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6816440197397581714_1320, duration: 5300603
2013-10-31 18:42:34,112 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6816440197397581714_1320 terminating
2013-10-31 18:42:34,112 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48748, dest: /127.0.0.1:54365, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6816440197397581714_1320, duration: 3926307
2013-10-31 18:42:34,113 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6816440197397581714_1320 terminating
2013-10-31 18:42:34,113 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48464, dest: /127.0.0.1:37740, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6816440197397581714_1320, duration: 7893806
2013-10-31 18:42:34,114 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6816440197397581714_1320 terminating
2013-10-31 18:42:34,114 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6816440197397581714_1320 size 25809
2013-10-31 18:42:34,118 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6816440197397581714_1320 size 25809
2013-10-31 18:42:34,118 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6816440197397581714_1320 size 25809
2013-10-31 18:42:34,119 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA from client DFSClient_-1193761217
2013-10-31 18:42:34,119 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA is closed by DFSClient_-1193761217
2013-10-31 18:42:34,126 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:34,127 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000000_0'
2013-10-31 18:42:34,127 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000001_0'
2013-10-31 18:42:34,128 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000005_0'
2013-10-31 18:42:34,129 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000006_0'
2013-10-31 18:42:34,129 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4951964880204109736 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:34,129 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4951964880204109736 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:34,129 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4951964880204109736 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:34,130 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:34,130 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0031 being deleted.
2013-10-31 18:42:34,130 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000002_0'
2013-10-31 18:42:34,130 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000003_0'
2013-10-31 18:42:34,131 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000004_0'
2013-10-31 18:42:34,132 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0031_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:34,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031	dst=null	perm=null
2013-10-31 18:42:34,137 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary
2013-10-31 18:42:34,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=null
2013-10-31 18:42:34,153 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 18:42:34,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000	dst=null	perm=null
2013-10-31 18:42:34,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001	dst=null	perm=null
2013-10-31 18:42:34,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002	dst=null	perm=null
2013-10-31 18:42:34,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003	dst=null	perm=null
2013-10-31 18:42:34,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004	dst=null	perm=null
2013-10-31 18:42:34,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000	dst=null	perm=null
2013-10-31 18:42:34,158 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44577, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1487922476689862061_1315, duration: 297683
2013-10-31 18:42:34,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001	dst=null	perm=null
2013-10-31 18:42:34,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51381, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3429000233400764538_1316, duration: 266174
2013-10-31 18:42:34,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002	dst=null	perm=null
2013-10-31 18:42:34,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51382, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7204826124865328506_1319, duration: 280772
2013-10-31 18:42:34,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003	dst=null	perm=null
2013-10-31 18:42:34,164 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48471, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6738845034354110760_1319, duration: 264483
2013-10-31 18:42:34,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004	dst=null	perm=null
2013-10-31 18:42:34,164 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/ungroupedanon
2013-10-31 18:42:34,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon	dst=null	perm=null
2013-10-31 18:42:34,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000	dst=null	perm=null
2013-10-31 18:42:34,168 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48755, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1487922476689862061_1315, duration: 263114
2013-10-31 18:42:34,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001	dst=null	perm=null
2013-10-31 18:42:34,170 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51385, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3429000233400764538_1316, duration: 262582
2013-10-31 18:42:34,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002	dst=null	perm=null
2013-10-31 18:42:34,173 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51386, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7204826124865328506_1319, duration: 262858
2013-10-31 18:42:34,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003	dst=null	perm=null
2013-10-31 18:42:34,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44584, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6738845034354110760_1319, duration: 262615
2013-10-31 18:42:34,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004	dst=null	perm=null
2013-10-31 18:42:34,186 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:42:34,186 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:42:34,202 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:42:34,202 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:42:34,202 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup"]
2013-10-31 18:42:34,203 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:42:34,203 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 2
2013-10-31 18:42:34,203 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 2
2013-10-31 18:42:34,204 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/2)
2013-10-31 18:42:34,208 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:42:34,209 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:42:34,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:34,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:42:34,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,338 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar. blk_1160688926521489425_1321
2013-10-31 18:42:34,339 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:48476 dest: /127.0.0.1:37740
2013-10-31 18:42:34,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:48760 dest: /127.0.0.1:54365
2013-10-31 18:42:34,345 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:51390 dest: /127.0.0.1:34578
2013-10-31 18:42:34,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51390, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1160688926521489425_1321, duration: 6955618
2013-10-31 18:42:34,356 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1160688926521489425_1321 terminating
2013-10-31 18:42:34,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48760, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1160688926521489425_1321, duration: 7714867
2013-10-31 18:42:34,357 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1160688926521489425_1321 terminating
2013-10-31 18:42:34,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48476, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1160688926521489425_1321, duration: 9059597
2013-10-31 18:42:34,357 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:34,358 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1160688926521489425_1321 terminating
2013-10-31 18:42:34,360 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar from client DFSClient_-1596270109
2013-10-31 18:42:34,360 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:42:34,361 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:34,362 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:34,366 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar. New replication is 10
2013-10-31 18:42:34,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=null
2013-10-31 18:42:34,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,383 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:42:34,387 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:42:34,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:42:34,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,409 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split. New replication is 10
2013-10-31 18:42:34,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=null
2013-10-31 18:42:34,420 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split. blk_-3261905793271309273_1322
2013-10-31 18:42:34,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:48479 dest: /127.0.0.1:37740
2013-10-31 18:42:34,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:48763 dest: /127.0.0.1:54365
2013-10-31 18:42:34,425 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:44590 dest: /127.0.0.1:59471
2013-10-31 18:42:34,427 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:51394 dest: /127.0.0.1:34578
2013-10-31 18:42:34,430 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51394, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3261905793271309273_1322, duration: 114639
2013-10-31 18:42:34,430 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,430 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,431 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44590, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3261905793271309273_1322, duration: 943113
2013-10-31 18:42:34,431 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,432 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48763, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3261905793271309273_1322, duration: 2172040
2013-10-31 18:42:34,432 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,433 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48479, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3261905793271309273_1322, duration: 3045446
2013-10-31 18:42:34,433 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,433 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,436 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split from client DFSClient_-1596270109
2013-10-31 18:42:34,436 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split is closed by DFSClient_-1596270109
2013-10-31 18:42:34,437 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,437 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,481 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo. blk_-8353909620816440750_1323
2013-10-31 18:42:34,483 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8353909620816440750_1323 src: /127.0.0.1:44592 dest: /127.0.0.1:59471
2013-10-31 18:42:34,484 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8353909620816440750_1323 src: /127.0.0.1:51396 dest: /127.0.0.1:34578
2013-10-31 18:42:34,486 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8353909620816440750_1323 src: /127.0.0.1:48485 dest: /127.0.0.1:37740
2013-10-31 18:42:34,489 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48485, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8353909620816440750_1323, duration: 67293
2013-10-31 18:42:34,489 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8353909620816440750_1323 terminating
2013-10-31 18:42:34,490 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51396, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8353909620816440750_1323, duration: 866987
2013-10-31 18:42:34,490 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8353909620816440750_1323 terminating
2013-10-31 18:42:34,490 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8353909620816440750_1323 size 156
2013-10-31 18:42:34,490 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44592, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8353909620816440750_1323, duration: 1726831
2013-10-31 18:42:34,491 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8353909620816440750_1323 size 156
2013-10-31 18:42:34,491 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8353909620816440750_1323 terminating
2013-10-31 18:42:34,493 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8353909620816440750_1323 size 156
2013-10-31 18:42:34,493 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:42:34,494 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:42:34,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,521 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml. blk_-8254353095833524668_1324
2013-10-31 18:42:34,522 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8254353095833524668_1324 src: /127.0.0.1:44595 dest: /127.0.0.1:59471
2013-10-31 18:42:34,524 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8254353095833524668_1324 src: /127.0.0.1:51399 dest: /127.0.0.1:34578
2013-10-31 18:42:34,526 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8254353095833524668_1324 src: /127.0.0.1:48771 dest: /127.0.0.1:54365
2013-10-31 18:42:34,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48771, dest: /127.0.0.1:54365, bytes: 28257, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 205036
2013-10-31 18:42:34,529 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8254353095833524668_1324 terminating
2013-10-31 18:42:34,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51399, dest: /127.0.0.1:34578, bytes: 28257, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8254353095833524668_1324, duration: 993961
2013-10-31 18:42:34,530 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8254353095833524668_1324 terminating
2013-10-31 18:42:34,530 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44595, dest: /127.0.0.1:59471, bytes: 28257, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8254353095833524668_1324, duration: 1903885
2013-10-31 18:42:34,531 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8254353095833524668_1324 terminating
2013-10-31 18:42:34,531 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8254353095833524668_1324 size 28257
2013-10-31 18:42:34,534 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml from client DFSClient_-1596270109
2013-10-31 18:42:34,534 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:42:34,534 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8254353095833524668_1324 size 28257
2013-10-31 18:42:34,535 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8254353095833524668_1324 size 28257
2013-10-31 18:42:34,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=null
2013-10-31 18:42:34,549 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44599, bytes: 28481, op: HDFS_READ, cliID: DFSClient_1455126413, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8254353095833524668_1324, duration: 376657
2013-10-31 18:42:34,557 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_1160688926521489425_1321 to datanode(s) 127.0.0.1:59471
2013-10-31 18:42:34,557 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_4951964880204109736_1314 blk_-3576267029470916644_1309 blk_602449860203028534_1311 blk_2501650952349019281_1310 blk_3405378349805446451_1308
2013-10-31 18:42:34,558 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_4951964880204109736_1314 blk_-3576267029470916644_1309 blk_2501650952349019281_1310 blk_3405378349805446451_1308
2013-10-31 18:42:34,567 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0032: nMaps=4 nReduces=1 max=-1
2013-10-31 18:42:34,568 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0032 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:42:34,568 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0032
2013-10-31 18:42:34,568 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0032	RESULT=SUCCESS
2013-10-31 18:42:34,568 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0032
2013-10-31 18:42:34,569 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0032
2013-10-31 18:42:34,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,598 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml. blk_-6329593982662489296_1326
2013-10-31 18:42:34,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6329593982662489296_1326 src: /127.0.0.1:48491 dest: /127.0.0.1:37740
2013-10-31 18:42:34,602 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6329593982662489296_1326 src: /127.0.0.1:51404 dest: /127.0.0.1:34578
2013-10-31 18:42:34,604 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6329593982662489296_1326 src: /127.0.0.1:48776 dest: /127.0.0.1:54365
2013-10-31 18:42:34,608 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48776, dest: /127.0.0.1:54365, bytes: 28322, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6329593982662489296_1326, duration: 581751
2013-10-31 18:42:34,608 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6329593982662489296_1326 terminating
2013-10-31 18:42:34,609 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51404, dest: /127.0.0.1:34578, bytes: 28322, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6329593982662489296_1326, duration: 1406512
2013-10-31 18:42:34,609 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6329593982662489296_1326 terminating
2013-10-31 18:42:34,609 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6329593982662489296_1326 size 28322
2013-10-31 18:42:34,610 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48491, dest: /127.0.0.1:37740, bytes: 28322, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6329593982662489296_1326, duration: 2585752
2013-10-31 18:42:34,610 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6329593982662489296_1326 terminating
2013-10-31 18:42:34,613 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml from client DFSClient_1455126413
2013-10-31 18:42:34,613 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml is closed by DFSClient_1455126413
2013-10-31 18:42:34,613 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6329593982662489296_1326 size 28322
2013-10-31 18:42:34,614 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6329593982662489296_1326 size 28322
2013-10-31 18:42:35,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:35,020 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken. blk_6124728671195132175_1327
2013-10-31 18:42:35,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6124728671195132175_1327 src: /127.0.0.1:48777 dest: /127.0.0.1:54365
2013-10-31 18:42:35,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6124728671195132175_1327 src: /127.0.0.1:44604 dest: /127.0.0.1:59471
2013-10-31 18:42:35,025 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6124728671195132175_1327 src: /127.0.0.1:48496 dest: /127.0.0.1:37740
2013-10-31 18:42:35,028 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48496, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6124728671195132175_1327, duration: 70834
2013-10-31 18:42:35,028 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6124728671195132175_1327 terminating
2013-10-31 18:42:35,028 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6124728671195132175_1327 size 116
2013-10-31 18:42:35,028 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44604, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 873091
2013-10-31 18:42:35,029 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6124728671195132175_1327 terminating
2013-10-31 18:42:35,029 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48777, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6124728671195132175_1327, duration: 1805574
2013-10-31 18:42:35,030 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6124728671195132175_1327 terminating
2013-10-31 18:42:35,032 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6124728671195132175_1327 size 116
2013-10-31 18:42:35,034 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6124728671195132175_1327 size 116
2013-10-31 18:42:35,034 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken from client DFSClient_-1596270109
2013-10-31 18:42:35,034 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:42:35,038 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken
2013-10-31 18:42:35,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:42:35,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44606, bytes: 160, op: HDFS_READ, cliID: DFSClient_1455126413, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8353909620816440750_1323, duration: 337069
2013-10-31 18:42:35,044 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0032 = 1449. Number of splits = 4
2013-10-31 18:42:35,044 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,044 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,047 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,047 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,047 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0032 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:42:35,048 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0032 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:42:35,960 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data6/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:35,960 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2501650952349019281_1310 file build/test/data/dfs/data/data5/current/blk_2501650952349019281 for deletion
2013-10-31 18:42:35,960 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data6/current/blk_-3576267029470916644
2013-10-31 18:42:35,960 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data5/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:35,960 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2501650952349019281_1310 at file build/test/data/dfs/data/data5/current/blk_2501650952349019281
2013-10-31 18:42:35,961 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4951964880204109736_1314 file build/test/data/dfs/data/data5/current/blk_4951964880204109736 for deletion
2013-10-31 18:42:35,961 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data5/current/blk_3405378349805446451
2013-10-31 18:42:35,962 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4951964880204109736_1314 at file build/test/data/dfs/data/data5/current/blk_4951964880204109736
2013-10-31 18:42:36,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data2/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:36,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_602449860203028534_1311 file build/test/data/dfs/data/data2/current/blk_602449860203028534 for deletion
2013-10-31 18:42:36,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data2/current/blk_-3576267029470916644
2013-10-31 18:42:36,357 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2501650952349019281_1310 file build/test/data/dfs/data/data1/current/blk_2501650952349019281 for deletion
2013-10-31 18:42:36,358 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_602449860203028534_1311 at file build/test/data/dfs/data/data2/current/blk_602449860203028534
2013-10-31 18:42:36,358 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data1/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:36,358 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2501650952349019281_1310 at file build/test/data/dfs/data/data1/current/blk_2501650952349019281
2013-10-31 18:42:36,358 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4951964880204109736_1314 file build/test/data/dfs/data/data2/current/blk_4951964880204109736 for deletion
2013-10-31 18:42:36,359 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data1/current/blk_3405378349805446451
2013-10-31 18:42:36,359 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4951964880204109736_1314 at file build/test/data/dfs/data/data2/current/blk_4951964880204109736
2013-10-31 18:42:36,429 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_1160688926521489425_1321 to 127.0.0.1:59471 
2013-10-31 18:42:36,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:44607 dest: /127.0.0.1:59471
2013-10-31 18:42:36,432 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_1160688926521489425_1321 to /127.0.0.1:59471
2013-10-31 18:42:36,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1160688926521489425_1321 src: /127.0.0.1:44607 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:42:36,440 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:37,134 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0032_m_000005_0' to tip task_20131031182606197_0032_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:37,146 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:42:37,147 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000005_0 which needs 1 slots
2013-10-31 18:42:37,147 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000005_0 which needs 1 slots
2013-10-31 18:42:37,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken	dst=null	perm=null
2013-10-31 18:42:37,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44608, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 129027
2013-10-31 18:42:37,154 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 68 raw values into 2 aggregated values, total 7
2013-10-31 18:42:37,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=null
2013-10-31 18:42:37,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48784, bytes: 28481, op: HDFS_READ, cliID: DFSClient_-2110053438, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 155689
2013-10-31 18:42:37,180 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:37,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=null
2013-10-31 18:42:37,197 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44611, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2110053438, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1160688926521489425_1321, duration: 1176859
2013-10-31 18:42:37,257 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0031_m_1888122456
2013-10-31 18:42:37,260 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1974 with signal TERM. Exit code 0
2013-10-31 18:42:37,261 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_1459871651
2013-10-31 18:42:37,261 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_1459871651 spawned.
2013-10-31 18:42:37,262 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000005_0/taskjvm.sh
2013-10-31 18:42:37,538 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:37,538 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:37,538 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:37,539 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_1888122456 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:42:37,558 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_4951964880204109736_1314
2013-10-31 18:42:38,231 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4951964880204109736_1314 file build/test/data/dfs/data/data4/current/blk_4951964880204109736 for deletion
2013-10-31 18:42:38,232 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4951964880204109736_1314 at file build/test/data/dfs/data/data4/current/blk_4951964880204109736
2013-10-31 18:42:38,276 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_1459871651 given task: attempt_20131031182606197_0032_m_000005_0
2013-10-31 18:42:38,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:39,129 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:39,130 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000005_0 not found in cache
2013-10-31 18:42:39,130 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000001_0 not found in cache
2013-10-31 18:42:39,130 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000000_0 not found in cache
2013-10-31 18:42:39,130 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383331359130
2013-10-31 18:42:39,131 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:39,131 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000002_0 not found in cache
2013-10-31 18:42:39,132 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000003_0 not found in cache
2013-10-31 18:42:39,132 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383331359132
2013-10-31 18:42:39,132 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:39,132 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000004_0 not found in cache
2013-10-31 18:42:39,132 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383331359132
2013-10-31 18:42:39,914 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_-1600883262 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:39,925 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2190 with signal TERM. Exit code 0
2013-10-31 18:42:40,092 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,092 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,092 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:40,092 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_-1600883262 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:42:40,146 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_1711463638 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:40,156 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2248 with signal TERM. Exit code 0
2013-10-31 18:42:40,161 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_-1236212079 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:40,167 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_1917937103 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:40,175 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2283 with signal TERM. Exit code 0
2013-10-31 18:42:40,179 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2284 with signal TERM. Exit code 0
2013-10-31 18:42:40,343 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,343 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,343 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:40,344 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_1711463638 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:40,352 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,352 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,352 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:40,352 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_-1236212079 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:40,391 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,391 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,391 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:42:40,391 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_1917937103 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:41,695 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000005_0 0.0% setup
2013-10-31 18:42:41,698 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000005_0 is done.
2013-10-31 18:42:41,699 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000005_0  was -1
2013-10-31 18:42:41,699 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:43,153 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000005_0' has completed task_20131031182606197_0032_m_000005 successfully.
2013-10-31 18:42:45,393 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000000_0' to tip task_20131031182606197_0032_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:45,394 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000000
2013-10-31 18:42:45,396 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000001_0' to tip task_20131031182606197_0032_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:42:45,396 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:42:45,398 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000000_0 which needs 1 slots
2013-10-31 18:42:45,399 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000001
2013-10-31 18:42:45,400 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000000_0 which needs 1 slots
2013-10-31 18:42:45,400 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000002_0' to tip task_20131031182606197_0032_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:42:45,402 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:42:45,402 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000002
2013-10-31 18:42:45,402 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000001_0 which needs 1 slots
2013-10-31 18:42:45,403 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000001_0 which needs 1 slots
2013-10-31 18:42:45,404 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000003_0' to tip task_20131031182606197_0032_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:42:45,406 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:42:45,407 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000003
2013-10-31 18:42:45,407 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000002_0 which needs 1 slots
2013-10-31 18:42:45,407 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000002_0 which needs 1 slots
2013-10-31 18:42:45,409 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:42:45,409 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000003_0 which needs 1 slots
2013-10-31 18:42:45,410 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000003_0 which needs 1 slots
2013-10-31 18:42:45,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken	dst=null	perm=null
2013-10-31 18:42:45,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken	dst=null	perm=null
2013-10-31 18:42:45,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken	dst=null	perm=null
2013-10-31 18:42:45,417 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48789, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6124728671195132175_1327, duration: 276452
2013-10-31 18:42:45,418 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44616, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 381668
2013-10-31 18:42:45,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=null
2013-10-31 18:42:45,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=null
2013-10-31 18:42:45,431 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51422, bytes: 28481, op: HDFS_READ, cliID: DFSClient_229997246, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8254353095833524668_1324, duration: 1062327
2013-10-31 18:42:45,433 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48794, bytes: 28481, op: HDFS_READ, cliID: DFSClient_-1391221529, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 3362681
2013-10-31 18:42:45,440 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_-549426104
2013-10-31 18:42:45,442 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_-549426104 spawned.
2013-10-31 18:42:45,443 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000000_0/taskjvm.sh
2013-10-31 18:42:45,449 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:45,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44621, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 119222
2013-10-31 18:42:45,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml	dst=null	perm=null
2013-10-31 18:42:45,460 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48797, bytes: 28481, op: HDFS_READ, cliID: DFSClient_-892306882, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 181594
2013-10-31 18:42:45,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=null
2013-10-31 18:42:45,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51427, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1391221529, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1160688926521489425_1321, duration: 631477
2013-10-31 18:42:45,471 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:45,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=null
2013-10-31 18:42:45,485 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51428, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-892306882, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1160688926521489425_1321, duration: 592503
2013-10-31 18:42:45,503 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:45,562 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_-907495285
2013-10-31 18:42:45,562 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_679453739
2013-10-31 18:42:45,563 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_-907495285 spawned.
2013-10-31 18:42:45,566 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_679453739 spawned.
2013-10-31 18:42:45,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar	dst=null	perm=null
2013-10-31 18:42:45,570 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000003_0/taskjvm.sh
2013-10-31 18:42:45,572 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000002_0/taskjvm.sh
2013-10-31 18:42:45,575 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48517, bytes: 239915, op: HDFS_READ, cliID: DFSClient_229997246, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1160688926521489425_1321, duration: 1661176
2013-10-31 18:42:46,357 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-549426104 given task: attempt_20131031182606197_0032_m_000000_0
2013-10-31 18:42:46,741 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_-1126554979
2013-10-31 18:42:46,742 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_-1126554979 spawned.
2013-10-31 18:42:46,743 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000001_0/taskjvm.sh
2013-10-31 18:42:46,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=null
2013-10-31 18:42:46,850 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48803, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3261905793271309273_1322, duration: 168940
2013-10-31 18:42:46,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:42:46,889 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51433, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 253950
2013-10-31 18:42:47,135 INFO  mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031182606197_0032_m_000000_0 is 1741 ms debug.
2013-10-31 18:42:47,728 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-907495285 given task: attempt_20131031182606197_0032_m_000003_0
2013-10-31 18:42:47,959 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-1126554979 given task: attempt_20131031182606197_0032_m_000001_0
2013-10-31 18:42:47,970 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_679453739 given task: attempt_20131031182606197_0032_m_000002_0
2013-10-31 18:42:48,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=null
2013-10-31 18:42:48,221 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48526, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3261905793271309273_1322, duration: 126521
2013-10-31 18:42:48,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:42:48,260 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48527, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000003_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 163044
2013-10-31 18:42:48,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=null
2013-10-31 18:42:48,455 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51442, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3261905793271309273_1322, duration: 161994
2013-10-31 18:42:48,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:42:48,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split	dst=null	perm=null
2013-10-31 18:42:48,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48531, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3261905793271309273_1322, duration: 169610
2013-10-31 18:42:48,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:42:48,541 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48815, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 151633
2013-10-31 18:42:48,745 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48816, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 184484
2013-10-31 18:42:49,776 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:42:49,779 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000000_0 is done.
2013-10-31 18:42:49,780 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000000_0  was 54
2013-10-31 18:42:49,780 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:50,398 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0032_m_000005_0
2013-10-31 18:42:50,399 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0032_m_000005_0
2013-10-31 18:42:50,399 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0032_m_000005_0 not found in cache
2013-10-31 18:42:51,151 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:42:51,154 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000003_0 is done.
2013-10-31 18:42:51,154 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000003_0  was 53
2013-10-31 18:42:51,155 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:51,385 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:42:51,390 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000001_0 is done.
2013-10-31 18:42:51,390 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000001_0  was 74
2013-10-31 18:42:51,390 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:51,402 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000000_0' has completed task_20131031182606197_0032_m_000000 successfully.
2013-10-31 18:42:51,403 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0032_r_000000_0' to tip task_20131031182606197_0032_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:51,408 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:42:51,408 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_r_000000_0 which needs 1 slots
2013-10-31 18:42:51,408 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_r_000000_0 which needs 1 slots
2013-10-31 18:42:51,412 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000001_0' has completed task_20131031182606197_0032_m_000001 successfully.
2013-10-31 18:42:51,414 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000003_0' has completed task_20131031182606197_0032_m_000003 successfully.
2013-10-31 18:42:51,427 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:42:51,429 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000002_0 is done.
2013-10-31 18:42:51,429 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000002_0  was 73
2013-10-31 18:42:51,429 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:51,442 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_r_-594210753
2013-10-31 18:42:51,444 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_r_-594210753 spawned.
2013-10-31 18:42:51,445 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_r_000000_0/taskjvm.sh
2013-10-31 18:42:52,413 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_r_-594210753 given task: attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:42:54,454 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000002_0' has completed task_20131031182606197_0032_m_000002 successfully.
2013-10-31 18:42:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:42:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,053 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,059 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,060 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:42:58,084 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42851, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000000_0, duration: 5987188
2013-10-31 18:42:58,100 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45528, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000001_0, duration: 9489271
2013-10-31 18:42:58,115 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50487, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000003_0, duration: 10828195
2013-10-31 18:42:58,133 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40833, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000002_0, duration: 12560875
2013-10-31 18:42:58,902 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:42:58,958 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:42:59,011 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:42:59,219 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1716 Total time for transactions(ms): 32Number of transactions batched in Syncs: 145 Number of syncs: 1204 SyncTimes(ms): 77100 16678 
2013-10-31 18:42:59,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:59,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:59,251 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000. blk_1107095905103096836_1328
2013-10-31 18:42:59,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107095905103096836_1328 src: /127.0.0.1:51453 dest: /127.0.0.1:34578
2013-10-31 18:42:59,287 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107095905103096836_1328 src: /127.0.0.1:44651 dest: /127.0.0.1:59471
2013-10-31 18:42:59,288 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107095905103096836_1328 src: /127.0.0.1:48826 dest: /127.0.0.1:54365
2013-10-31 18:42:59,293 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48826, dest: /127.0.0.1:54365, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0032_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1107095905103096836_1328, duration: 1647751
2013-10-31 18:42:59,293 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1107095905103096836_1328 terminating
2013-10-31 18:42:59,293 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44651, dest: /127.0.0.1:59471, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0032_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1107095905103096836_1328, duration: 3539623
2013-10-31 18:42:59,293 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1107095905103096836_1328 terminating
2013-10-31 18:42:59,293 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51453, dest: /127.0.0.1:34578, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0032_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1107095905103096836_1328, duration: 3726849
2013-10-31 18:42:59,294 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1107095905103096836_1328 terminating
2013-10-31 18:42:59,295 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1107095905103096836_1328 size 310
2013-10-31 18:42:59,295 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1107095905103096836_1328 size 310
2013-10-31 18:42:59,296 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:42:59,296 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:42:59,297 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1107095905103096836_1328 size 310
2013-10-31 18:42:59,331 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0032_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:59,331 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:43:00,417 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   4 OK for attempt_20131031182606197_0032_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:43:00,418 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:43:01,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0	dst=null	perm=null
2013-10-31 18:43:01,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:01,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:01,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0	dst=null	perm=null
2013-10-31 18:43:01,938 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:01,940 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:01,941 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_r_000000_0 is done.
2013-10-31 18:43:01,941 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_r_000000_0  was -1
2013-10-31 18:43:01,941 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:03,421 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_r_000000_0' has completed task_20131031182606197_0032_r_000000 successfully.
2013-10-31 18:43:03,425 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0032_m_000004_0' to tip task_20131031182606197_0032_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:03,427 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:43:03,428 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000004_0 which needs 1 slots
2013-10-31 18:43:03,428 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000004_0 which needs 1 slots
2013-10-31 18:43:03,459 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0032/attempt_20131031182606197_0032_m_000004_0. Attempting to reuse: jvm_20131031182606197_0032_m_-549426104
2013-10-31 18:43:03,857 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-549426104 given task: attempt_20131031182606197_0032_m_000004_0
2013-10-31 18:43:03,994 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000004_0 0.0% 
2013-10-31 18:43:04,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary	dst=null	perm=null
2013-10-31 18:43:04,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:04,011 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_SUCCESS from client DFSClient_attempt_20131031182606197_0032_m_000004_0
2013-10-31 18:43:04,011 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0032_m_000004_0
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,016 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8353909620816440750 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8353909620816440750 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8353909620816440750 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8254353095833524668 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8254353095833524668 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,017 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8254353095833524668 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:04,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032	dst=null	perm=null
2013-10-31 18:43:04,562 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-8254353095833524668_1324 blk_-8353909620816440750_1323 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:04,563 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-8254353095833524668_1324 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:05,241 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8254353095833524668_1324 file build/test/data/dfs/data/data4/current/blk_-8254353095833524668 for deletion
2013-10-31 18:43:05,241 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data3/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:05,241 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8254353095833524668_1324 at file build/test/data/dfs/data/data4/current/blk_-8254353095833524668
2013-10-31 18:43:05,242 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data4/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:05,242 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data3/current/blk_-3261905793271309273
2013-10-31 18:43:05,242 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data4/current/blk_1160688926521489425
2013-10-31 18:43:06,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8353909620816440750_1323 file build/test/data/dfs/data/data1/current/blk_-8353909620816440750 for deletion
2013-10-31 18:43:06,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8254353095833524668_1324 file build/test/data/dfs/data/data2/current/blk_-8254353095833524668 for deletion
2013-10-31 18:43:06,367 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8353909620816440750_1323 at file build/test/data/dfs/data/data1/current/blk_-8353909620816440750
2013-10-31 18:43:06,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8254353095833524668_1324 at file build/test/data/dfs/data/data2/current/blk_-8254353095833524668
2013-10-31 18:43:06,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data2/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:06,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data1/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:06,368 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data2/current/blk_-3261905793271309273
2013-10-31 18:43:06,369 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data1/current/blk_1160688926521489425
2013-10-31 18:43:06,942 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000004_0 0.0% cleanup
2013-10-31 18:43:06,944 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000004_0 is done.
2013-10-31 18:43:06,944 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000004_0  was -1
2013-10-31 18:43:06,944 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:07,563 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-8353909620816440750_1323 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:07,563 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-8254353095833524668_1324 blk_-8353909620816440750_1323 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:08,428 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:43:08,428 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:43:08,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8353909620816440750_1323 file build/test/data/dfs/data/data5/current/blk_-8353909620816440750 for deletion
2013-10-31 18:43:08,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8254353095833524668_1324 file build/test/data/dfs/data/data6/current/blk_-8254353095833524668 for deletion
2013-10-31 18:43:08,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8353909620816440750_1323 at file build/test/data/dfs/data/data5/current/blk_-8353909620816440750
2013-10-31 18:43:08,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data6/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:08,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8254353095833524668_1324 at file build/test/data/dfs/data/data6/current/blk_-8254353095833524668
2013-10-31 18:43:08,972 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data6/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:08,972 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data6/current/blk_-3261905793271309273
2013-10-31 18:43:08,973 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data6/current/blk_1160688926521489425
2013-10-31 18:43:09,434 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000004_0' has completed task_20131031182606197_0032_m_000004 successfully.
2013-10-31 18:43:09,435 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0032 has completed successfully.
2013-10-31 18:43:09,435 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0032,submitTime=1383244954540,launchTime=1383244955047,firstMapTaskLaunchTime=1383244965393,firstReduceTaskLaunchTime=1383244971403,firstJobSetupTaskLaunchTime=1383244957134,firstJobCleanupTaskLaunchTime=1383244983424,finishTime=1383244989435,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=28,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[9E722C5C544D4F6E9EA520E87CC987CE/D4BCCB91172545369A5D752C23CF3411] test/(1/2)
2013-10-31 18:43:09,439 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536. blk_5204921068052043086_1329
2013-10-31 18:43:09,442 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8353909620816440750_1323 file build/test/data/dfs/data/data8/current/blk_-8353909620816440750 for deletion
2013-10-31 18:43:09,444 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data7/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:09,444 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8353909620816440750_1323 at file build/test/data/dfs/data/data8/current/blk_-8353909620816440750
2013-10-31 18:43:09,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data8/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:09,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5204921068052043086_1329 src: /127.0.0.1:48829 dest: /127.0.0.1:54365
2013-10-31 18:43:09,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data7/current/blk_-3261905793271309273
2013-10-31 18:43:09,445 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data8/current/blk_1160688926521489425
2013-10-31 18:43:09,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5204921068052043086_1329 src: /127.0.0.1:51459 dest: /127.0.0.1:34578
2013-10-31 18:43:09,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5204921068052043086_1329 src: /127.0.0.1:48549 dest: /127.0.0.1:37740
2013-10-31 18:43:09,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48549, dest: /127.0.0.1:37740, bytes: 28270, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5204921068052043086_1329, duration: 69246
2013-10-31 18:43:09,456 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5204921068052043086_1329 terminating
2013-10-31 18:43:09,457 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5204921068052043086_1329 size 28270
2013-10-31 18:43:09,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51459, dest: /127.0.0.1:34578, bytes: 28270, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5204921068052043086_1329, duration: 4989859
2013-10-31 18:43:09,457 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5204921068052043086_1329 terminating
2013-10-31 18:43:09,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48829, dest: /127.0.0.1:54365, bytes: 28270, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5204921068052043086_1329, duration: 6056686
2013-10-31 18:43:09,458 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5204921068052043086_1329 terminating
2013-10-31 18:43:09,460 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5204921068052043086_1329 size 28270
2013-10-31 18:43:09,461 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 from client DFSClient_1455126413
2013-10-31 18:43:09,461 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 is closed by DFSClient_1455126413
2013-10-31 18:43:09,462 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5204921068052043086_1329 size 28270
2013-10-31 18:43:09,468 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:09,469 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000000_0'
2013-10-31 18:43:09,469 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000004_0'
2013-10-31 18:43:09,470 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000005_0'
2013-10-31 18:43:09,470 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_r_000000_0'
2013-10-31 18:43:09,471 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6124728671195132175 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:09,472 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6124728671195132175 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:09,472 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6124728671195132175 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:09,472 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000003_0'
2013-10-31 18:43:09,473 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000001_0'
2013-10-31 18:43:09,475 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000002_0'
2013-10-31 18:43:09,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032	dst=null	perm=null
2013-10-31 18:43:09,478 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0032_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:09,480 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (2/2) ...dpipesplatform/groupgroup
2013-10-31 18:43:09,486 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:43:09,487 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:43:09,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:09,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:43:09,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:09,510 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar. blk_-2470905291057701022_1330
2013-10-31 18:43:09,511 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:48834 dest: /127.0.0.1:54365
2013-10-31 18:43:09,513 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:51464 dest: /127.0.0.1:34578
2013-10-31 18:43:09,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:44662 dest: /127.0.0.1:59471
2013-10-31 18:43:09,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44662, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2470905291057701022_1330, duration: 6908161
2013-10-31 18:43:09,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2470905291057701022_1330 terminating
2013-10-31 18:43:09,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51464, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2470905291057701022_1330, duration: 6672042
2013-10-31 18:43:09,523 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2470905291057701022_1330 terminating
2013-10-31 18:43:09,524 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48834, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2470905291057701022_1330, duration: 6666359
2013-10-31 18:43:09,524 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2470905291057701022_1330 terminating
2013-10-31 18:43:09,526 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:09,526 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:09,527 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:09,926 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar from client DFSClient_-1596270109
2013-10-31 18:43:09,927 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:43:09,935 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar. New replication is 10
2013-10-31 18:43:09,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar	dst=null	perm=null
2013-10-31 18:43:09,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:09,950 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:43:09,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2	dst=null	perm=null
2013-10-31 18:43:09,955 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:43:09,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000	dst=null	perm=null
2013-10-31 18:43:09,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:10,564 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2470905291057701022_1330 to datanode(s) 127.0.0.1:37740
2013-10-31 18:43:10,565 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_6124728671195132175_1327
2013-10-31 18:43:10,565 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_6124728671195132175_1327
2013-10-31 18:43:11,243 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2470905291057701022_1330 to 127.0.0.1:37740 
2013-10-31 18:43:11,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:48554 dest: /127.0.0.1:37740
2013-10-31 18:43:11,245 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2470905291057701022_1330 to /127.0.0.1:37740
2013-10-31 18:43:11,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2470905291057701022_1330 src: /127.0.0.1:48554 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:43:11,252 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:11,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,804 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split. New replication is 10
2013-10-31 18:43:11,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split	dst=null	perm=null
2013-10-31 18:43:11,812 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split. blk_-7533221922779966677_1331
2013-10-31 18:43:11,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:48838 dest: /127.0.0.1:54365
2013-10-31 18:43:11,816 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:51468 dest: /127.0.0.1:34578
2013-10-31 18:43:11,817 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:44666 dest: /127.0.0.1:59471
2013-10-31 18:43:11,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:48558 dest: /127.0.0.1:37740
2013-10-31 18:43:11,822 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48558, dest: /127.0.0.1:37740, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7533221922779966677_1331, duration: 996133
2013-10-31 18:43:11,823 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,823 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44666, dest: /127.0.0.1:59471, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7533221922779966677_1331, duration: 910306
2013-10-31 18:43:11,823 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,824 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51468, dest: /127.0.0.1:34578, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7533221922779966677_1331, duration: 1795881
2013-10-31 18:43:11,825 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,825 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48838, dest: /127.0.0.1:54365, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7533221922779966677_1331, duration: 2967212
2013-10-31 18:43:11,826 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,826 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,829 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,829 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,830 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,830 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split from client DFSClient_-1596270109
2013-10-31 18:43:11,831 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split is closed by DFSClient_-1596270109
2013-10-31 18:43:11,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,849 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo. blk_7520970391311344253_1332
2013-10-31 18:43:11,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7520970391311344253_1332 src: /127.0.0.1:48842 dest: /127.0.0.1:54365
2013-10-31 18:43:11,852 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7520970391311344253_1332 src: /127.0.0.1:48560 dest: /127.0.0.1:37740
2013-10-31 18:43:11,853 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7520970391311344253_1332 src: /127.0.0.1:51473 dest: /127.0.0.1:34578
2013-10-31 18:43:11,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51473, dest: /127.0.0.1:34578, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7520970391311344253_1332, duration: 89043
2013-10-31 18:43:11,858 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7520970391311344253_1332 terminating
2013-10-31 18:43:11,859 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48560, dest: /127.0.0.1:37740, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7520970391311344253_1332, duration: 2840758
2013-10-31 18:43:11,859 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7520970391311344253_1332 terminating
2013-10-31 18:43:11,860 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48842, dest: /127.0.0.1:54365, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7520970391311344253_1332, duration: 3706044
2013-10-31 18:43:11,860 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7520970391311344253_1332 terminating
2013-10-31 18:43:11,862 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7520970391311344253_1332 size 45
2013-10-31 18:43:11,863 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7520970391311344253_1332 size 45
2013-10-31 18:43:11,864 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:43:11,864 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:43:11,865 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7520970391311344253_1332 size 45
2013-10-31 18:43:11,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,893 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml. blk_5794936352752417851_1333
2013-10-31 18:43:11,895 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5794936352752417851_1333 src: /127.0.0.1:48845 dest: /127.0.0.1:54365
2013-10-31 18:43:11,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5794936352752417851_1333 src: /127.0.0.1:44672 dest: /127.0.0.1:59471
2013-10-31 18:43:11,898 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5794936352752417851_1333 src: /127.0.0.1:48564 dest: /127.0.0.1:37740
2013-10-31 18:43:11,901 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48564, dest: /127.0.0.1:37740, bytes: 28569, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5794936352752417851_1333, duration: 277484
2013-10-31 18:43:11,901 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5794936352752417851_1333 terminating
2013-10-31 18:43:11,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44672, dest: /127.0.0.1:59471, bytes: 28569, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5794936352752417851_1333, duration: 1059122
2013-10-31 18:43:11,902 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5794936352752417851_1333 terminating
2013-10-31 18:43:11,902 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5794936352752417851_1333 size 28569
2013-10-31 18:43:11,903 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48845, dest: /127.0.0.1:54365, bytes: 28569, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5794936352752417851_1333, duration: 1901496
2013-10-31 18:43:11,903 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5794936352752417851_1333 size 28569
2013-10-31 18:43:11,903 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5794936352752417851_1333 terminating
2013-10-31 18:43:11,905 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml from client DFSClient_-1596270109
2013-10-31 18:43:11,905 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:43:11,906 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5794936352752417851_1333 size 28569
2013-10-31 18:43:11,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml	dst=null	perm=null
2013-10-31 18:43:11,923 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48566, bytes: 28793, op: HDFS_READ, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5794936352752417851_1333, duration: 428407
2013-10-31 18:43:11,942 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0033: nMaps=1 nReduces=1 max=-1
2013-10-31 18:43:11,942 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0033 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:43:11,942 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0033
2013-10-31 18:43:11,942 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0033	RESULT=SUCCESS
2013-10-31 18:43:11,943 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0033
2013-10-31 18:43:11,944 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0033
2013-10-31 18:43:11,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,971 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6124728671195132175_1327 file build/test/data/dfs/data/data5/current/blk_6124728671195132175 for deletion
2013-10-31 18:43:11,972 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6124728671195132175_1327 at file build/test/data/dfs/data/data5/current/blk_6124728671195132175
2013-10-31 18:43:11,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,980 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml. blk_-3092982248583927606_1335
2013-10-31 18:43:11,982 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3092982248583927606_1335 src: /127.0.0.1:44676 dest: /127.0.0.1:59471
2013-10-31 18:43:11,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3092982248583927606_1335 src: /127.0.0.1:48568 dest: /127.0.0.1:37740
2013-10-31 18:43:11,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3092982248583927606_1335 src: /127.0.0.1:48852 dest: /127.0.0.1:54365
2013-10-31 18:43:11,989 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48852, dest: /127.0.0.1:54365, bytes: 28634, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3092982248583927606_1335, duration: 555807
2013-10-31 18:43:11,990 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3092982248583927606_1335 terminating
2013-10-31 18:43:11,990 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3092982248583927606_1335 size 28634
2013-10-31 18:43:11,990 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48568, dest: /127.0.0.1:37740, bytes: 28634, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3092982248583927606_1335, duration: 1882042
2013-10-31 18:43:11,991 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3092982248583927606_1335 terminating
2013-10-31 18:43:11,991 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44676, dest: /127.0.0.1:59471, bytes: 28634, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3092982248583927606_1335, duration: 2751577
2013-10-31 18:43:11,992 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3092982248583927606_1335 size 28634
2013-10-31 18:43:11,992 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3092982248583927606_1335 terminating
2013-10-31 18:43:11,996 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml from client DFSClient_1872362589
2013-10-31 18:43:11,997 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml is closed by DFSClient_1872362589
2013-10-31 18:43:11,997 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3092982248583927606_1335 size 28634
2013-10-31 18:43:12,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:12,010 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken. blk_5135335180789234108_1336
2013-10-31 18:43:12,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5135335180789234108_1336 src: /127.0.0.1:48570 dest: /127.0.0.1:37740
2013-10-31 18:43:12,014 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5135335180789234108_1336 src: /127.0.0.1:44680 dest: /127.0.0.1:59471
2013-10-31 18:43:12,015 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5135335180789234108_1336 src: /127.0.0.1:48855 dest: /127.0.0.1:54365
2013-10-31 18:43:12,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48855, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5135335180789234108_1336, duration: 74075
2013-10-31 18:43:12,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5135335180789234108_1336 terminating
2013-10-31 18:43:12,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44680, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5135335180789234108_1336, duration: 846767
2013-10-31 18:43:12,019 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5135335180789234108_1336 terminating
2013-10-31 18:43:12,019 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5135335180789234108_1336 size 116
2013-10-31 18:43:12,020 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48570, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5135335180789234108_1336, duration: 1787639
2013-10-31 18:43:12,020 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5135335180789234108_1336 size 116
2013-10-31 18:43:12,020 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5135335180789234108_1336 terminating
2013-10-31 18:43:12,025 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5135335180789234108_1336 size 116
2013-10-31 18:43:12,025 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken from client DFSClient_-1596270109
2013-10-31 18:43:12,026 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:43:12,031 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken
2013-10-31 18:43:12,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:43:12,035 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48573, bytes: 49, op: HDFS_READ, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7520970391311344253_1332, duration: 287083
2013-10-31 18:43:12,036 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0033 = 310. Number of splits = 1
2013-10-31 18:43:12,036 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:12,036 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:12,036 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:12,037 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0033 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:43:12,037 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0033 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 18:43:12,441 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6124728671195132175_1327 file build/test/data/dfs/data/data8/current/blk_6124728671195132175 for deletion
2013-10-31 18:43:12,442 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6124728671195132175_1327 at file build/test/data/dfs/data/data8/current/blk_6124728671195132175
2013-10-31 18:43:12,476 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0033_m_000002_0' to tip task_20131031182606197_0033_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:12,485 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:43:12,485 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_m_000002_0 which needs 1 slots
2013-10-31 18:43:12,486 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_m_000002_0 which needs 1 slots
2013-10-31 18:43:12,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken	dst=null	perm=null
2013-10-31 18:43:12,494 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48574, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5135335180789234108_1336, duration: 275650
2013-10-31 18:43:12,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml	dst=null	perm=null
2013-10-31 18:43:12,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44685, bytes: 28793, op: HDFS_READ, cliID: DFSClient_-1724905577, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5794936352752417851_1333, duration: 397219
2013-10-31 18:43:12,533 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:12,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar	dst=null	perm=null
2013-10-31 18:43:12,562 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44686, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1724905577, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2470905291057701022_1330, duration: 1220869
2013-10-31 18:43:12,660 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0032_m_1459871651
2013-10-31 18:43:12,667 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2683 with signal TERM. Exit code 0
2013-10-31 18:43:12,667 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0033_m_317850141
2013-10-31 18:43:12,667 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0033_m_317850141 spawned.
2013-10-31 18:43:12,669 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0033/attempt_20131031182606197_0033_m_000002_0/taskjvm.sh
2013-10-31 18:43:13,547 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:13,547 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:13,547 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:13,547 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_1459871651 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:13,565 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_6124728671195132175_1327
2013-10-31 18:43:14,243 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6124728671195132175_1327 file build/test/data/dfs/data/data4/current/blk_6124728671195132175 for deletion
2013-10-31 18:43:14,244 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6124728671195132175_1327 at file build/test/data/dfs/data/data4/current/blk_6124728671195132175
2013-10-31 18:43:14,256 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_m_317850141 given task: attempt_20131031182606197_0033_m_000002_0
2013-10-31 18:43:14,472 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,472 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0032_m_000004_0 not found in cache
2013-10-31 18:43:14,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394473
2013-10-31 18:43:14,473 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,473 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394473
2013-10-31 18:43:14,475 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,476 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394476
2013-10-31 18:43:14,478 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,478 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394478
2013-10-31 18:43:14,480 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_r_-594210753 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:14,485 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3117 with signal TERM. Exit code 0
2013-10-31 18:43:14,611 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_679453739 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:14,616 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2962 with signal TERM. Exit code 0
2013-10-31 18:43:14,640 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:14,640 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:14,640 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:14,640 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_r_-594210753 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:14,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:14,808 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:14,808 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:14,808 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:14,808 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_679453739 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:14,983 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_-549426104 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:14,993 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2861 with signal TERM. Exit code 0
2013-10-31 18:43:15,176 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:15,176 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:15,176 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:15,176 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_-549426104 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:43:15,734 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_-907495285 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:15,744 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2926 with signal TERM. Exit code 0
2013-10-31 18:43:15,968 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_-1126554979 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:15,974 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2963 with signal TERM. Exit code 0
2013-10-31 18:43:15,997 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:15,997 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:15,997 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:15,998 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_-907495285 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:16,189 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:16,189 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:16,189 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:16,189 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_-1126554979 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:17,707 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000002_0 0.0% setup
2013-10-31 18:43:17,709 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_m_000002_0 is done.
2013-10-31 18:43:17,710 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_m_000002_0  was -1
2013-10-31 18:43:17,710 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:18,492 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_m_000002_0' has completed task_20131031182606197_0033_m_000002 successfully.
2013-10-31 18:43:18,727 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0033_m_000000_0' to tip task_20131031182606197_0033_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:18,728 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0033_m_000000
2013-10-31 18:43:18,731 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:18,731 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_m_000000_0 which needs 1 slots
2013-10-31 18:43:18,732 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_m_000000_0 which needs 1 slots
2013-10-31 18:43:18,760 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0033_m_1954828324
2013-10-31 18:43:18,761 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0033_m_1954828324 spawned.
2013-10-31 18:43:18,763 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0033/attempt_20131031182606197_0033_m_000000_0/taskjvm.sh
2013-10-31 18:43:19,566 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_m_1954828324 given task: attempt_20131031182606197_0033_m_000000_0
2013-10-31 18:43:20,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split	dst=null	perm=null
2013-10-31 18:43:20,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48866, bytes: 355, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0033_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7533221922779966677_1331, duration: 148955
2013-10-31 18:43:20,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000	dst=null	perm=null
2013-10-31 18:43:20,141 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44693, bytes: 314, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0033_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1107095905103096836_1328, duration: 263311
2013-10-31 18:43:23,013 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000:0+310
2013-10-31 18:43:23,016 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_m_000000_0 is done.
2013-10-31 18:43:23,016 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_m_000000_0  was 230
2013-10-31 18:43:23,017 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:23,732 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0033_m_000002_0
2013-10-31 18:43:23,732 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0033_m_000002_0
2013-10-31 18:43:23,732 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0033_m_000002_0 not found in cache
2013-10-31 18:43:24,738 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_m_000000_0' has completed task_20131031182606197_0033_m_000000 successfully.
2013-10-31 18:43:24,739 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0033_r_000000_0' to tip task_20131031182606197_0033_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:24,742 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:24,743 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_r_000000_0 which needs 1 slots
2013-10-31 18:43:24,743 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_r_000000_0 which needs 1 slots
2013-10-31 18:43:24,777 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0033_r_103233333
2013-10-31 18:43:24,778 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0033_r_103233333 spawned.
2013-10-31 18:43:24,780 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0033/attempt_20131031182606197_0033_r_000000_0/taskjvm.sh
2013-10-31 18:43:25,722 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_r_103233333 given task: attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:31,465 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42901, bytes: 230, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0033_m_000000_0, duration: 10775198
2013-10-31 18:43:32,238 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:32,308 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_800740813804517052_1298
2013-10-31 18:43:32,309 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:32,375 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:32,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:32,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:32,721 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000. blk_-3315728293189659166_1337
2013-10-31 18:43:32,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315728293189659166_1337 src: /127.0.0.1:51500 dest: /127.0.0.1:34578
2013-10-31 18:43:32,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315728293189659166_1337 src: /127.0.0.1:48589 dest: /127.0.0.1:37740
2013-10-31 18:43:32,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315728293189659166_1337 src: /127.0.0.1:48873 dest: /127.0.0.1:54365
2013-10-31 18:43:32,765 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48873, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0033_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3315728293189659166_1337, duration: 919282
2013-10-31 18:43:32,766 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3315728293189659166_1337 terminating
2013-10-31 18:43:32,766 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48589, dest: /127.0.0.1:37740, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0033_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3315728293189659166_1337, duration: 1313518
2013-10-31 18:43:32,766 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3315728293189659166_1337 terminating
2013-10-31 18:43:32,766 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51500, dest: /127.0.0.1:34578, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0033_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3315728293189659166_1337, duration: 1718851
2013-10-31 18:43:32,767 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3315728293189659166_1337 terminating
2013-10-31 18:43:32,771 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3315728293189659166_1337 size 128
2013-10-31 18:43:32,771 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:32,772 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:32,772 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3315728293189659166_1337 size 128
2013-10-31 18:43:32,772 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3315728293189659166_1337 size 128
2013-10-31 18:43:32,810 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0033_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:43:32,810 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:33,751 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0033_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:43:33,753 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:33,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0	dst=null	perm=null
2013-10-31 18:43:33,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:33,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:33,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0	dst=null	perm=null
2013-10-31 18:43:35,289 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:35,292 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:35,293 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_r_000000_0 is done.
2013-10-31 18:43:35,294 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_r_000000_0  was -1
2013-10-31 18:43:35,294 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:36,757 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_r_000000_0' has completed task_20131031182606197_0033_r_000000 successfully.
2013-10-31 18:43:36,760 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0033_m_000001_0' to tip task_20131031182606197_0033_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:36,763 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:43:36,763 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_m_000001_0 which needs 1 slots
2013-10-31 18:43:36,763 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_m_000001_0 which needs 1 slots
2013-10-31 18:43:36,797 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0033/attempt_20131031182606197_0033_m_000001_0. Attempting to reuse: jvm_20131031182606197_0033_m_317850141
2013-10-31 18:43:37,806 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_m_317850141 given task: attempt_20131031182606197_0033_m_000001_0
2013-10-31 18:43:37,917 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000001_0 0.0% 
2013-10-31 18:43:37,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary	dst=null	perm=null
2013-10-31 18:43:37,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:37,964 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_SUCCESS from client DFSClient_attempt_20131031182606197_0033_m_000001_0
2013-10-31 18:43:37,964 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0033_m_000001_0
2013-10-31 18:43:37,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:37,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:37,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,972 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,973 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,973 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:37,973 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:37,973 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7520970391311344253 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,974 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7520970391311344253 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:37,974 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7520970391311344253 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,974 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5794936352752417851 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:37,974 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5794936352752417851 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,974 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5794936352752417851 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033	dst=null	perm=null
2013-10-31 18:43:40,570 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5794936352752417851_1333 blk_-2470905291057701022_1330 blk_-7533221922779966677_1331 blk_7520970391311344253_1332
2013-10-31 18:43:40,570 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_5794936352752417851_1333 blk_-2470905291057701022_1330 blk_-7533221922779966677_1331 blk_7520970391311344253_1332
2013-10-31 18:43:40,889 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000001_0 0.0% cleanup
2013-10-31 18:43:40,890 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_m_000001_0 is done.
2013-10-31 18:43:40,891 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_m_000001_0  was -1
2013-10-31 18:43:40,891 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:41,253 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data4/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:41,253 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data3/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:41,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data4/current/blk_-7533221922779966677
2013-10-31 18:43:41,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5794936352752417851_1333 file build/test/data/dfs/data/data4/current/blk_5794936352752417851 for deletion
2013-10-31 18:43:41,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data3/current/blk_-2470905291057701022
2013-10-31 18:43:41,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7520970391311344253_1332 file build/test/data/dfs/data/data3/current/blk_7520970391311344253 for deletion
2013-10-31 18:43:41,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5794936352752417851_1333 at file build/test/data/dfs/data/data4/current/blk_5794936352752417851
2013-10-31 18:43:41,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7520970391311344253_1332 at file build/test/data/dfs/data/data3/current/blk_7520970391311344253
2013-10-31 18:43:41,763 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:41,764 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:42,452 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data7/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:42,452 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data8/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:42,452 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data7/current/blk_-7533221922779966677
2013-10-31 18:43:42,452 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5794936352752417851_1333 file build/test/data/dfs/data/data7/current/blk_5794936352752417851 for deletion
2013-10-31 18:43:42,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data8/current/blk_-2470905291057701022
2013-10-31 18:43:42,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5794936352752417851_1333 at file build/test/data/dfs/data/data7/current/blk_5794936352752417851
2013-10-31 18:43:42,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7520970391311344253_1332 file build/test/data/dfs/data/data8/current/blk_7520970391311344253 for deletion
2013-10-31 18:43:42,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7520970391311344253_1332 at file build/test/data/dfs/data/data8/current/blk_7520970391311344253
2013-10-31 18:43:42,770 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_m_000001_0' has completed task_20131031182606197_0033_m_000001 successfully.
2013-10-31 18:43:42,771 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0033 has completed successfully.
2013-10-31 18:43:42,771 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0033,submitTime=1383244991914,launchTime=1383244992037,firstMapTaskLaunchTime=1383244998727,firstReduceTaskLaunchTime=1383245004739,firstJobSetupTaskLaunchTime=1383244992476,firstJobCleanupTaskLaunchTime=1383245016760,finishTime=1383245022771,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[9E722C5C544D4F6E9EA520E87CC987CE/8E6D0FBB17654B29B133D7BC321806AC] test/(2/2) ...dpipesplatform/groupgroup
2013-10-31 18:43:42,775 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29. blk_6508054468461277982_1338
2013-10-31 18:43:42,777 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6508054468461277982_1338 src: /127.0.0.1:48596 dest: /127.0.0.1:37740
2013-10-31 18:43:42,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6508054468461277982_1338 src: /127.0.0.1:44706 dest: /127.0.0.1:59471
2013-10-31 18:43:42,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6508054468461277982_1338 src: /127.0.0.1:51510 dest: /127.0.0.1:34578
2013-10-31 18:43:42,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51510, dest: /127.0.0.1:34578, bytes: 16901, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6508054468461277982_1338, duration: 6106694
2013-10-31 18:43:42,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6508054468461277982_1338 terminating
2013-10-31 18:43:42,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44706, dest: /127.0.0.1:59471, bytes: 16901, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6508054468461277982_1338, duration: 5212582
2013-10-31 18:43:42,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6508054468461277982_1338 terminating
2013-10-31 18:43:42,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48596, dest: /127.0.0.1:37740, bytes: 16901, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6508054468461277982_1338, duration: 4463352
2013-10-31 18:43:42,794 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6508054468461277982_1338 terminating
2013-10-31 18:43:42,800 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6508054468461277982_1338 size 16901
2013-10-31 18:43:42,800 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 from client DFSClient_1872362589
2013-10-31 18:43:42,801 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 is closed by DFSClient_1872362589
2013-10-31 18:43:42,801 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6508054468461277982_1338 size 16901
2013-10-31 18:43:42,802 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6508054468461277982_1338 size 16901
2013-10-31 18:43:42,809 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:42,810 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_m_000000_0'
2013-10-31 18:43:42,810 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_m_000001_0'
2013-10-31 18:43:42,810 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_m_000002_0'
2013-10-31 18:43:42,811 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5135335180789234108 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:42,811 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_r_000000_0'
2013-10-31 18:43:42,812 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5135335180789234108 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:42,812 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5135335180789234108 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,818 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5204921068052043086 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:42,819 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5204921068052043086 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:42,819 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5204921068052043086 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,819 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6329593982662489296 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,819 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6329593982662489296 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:42,820 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6329593982662489296 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:42,820 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1107095905103096836 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:42,820 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1107095905103096836 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:42,820 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1107095905103096836 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,837 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0033_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:42,851 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:42,851 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:42,851 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0033 being deleted.
2013-10-31 18:43:42,851 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0033 being deleted.
2013-10-31 18:43:42,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033	dst=null	perm=null
2013-10-31 18:43:42,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2	dst=null	perm=null
2013-10-31 18:43:42,978 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary
2013-10-31 18:43:42,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup	dst=null	perm=null
2013-10-31 18:43:42,997 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:43:42,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000	dst=null	perm=null
2013-10-31 18:43:43,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000	dst=null	perm=null
2013-10-31 18:43:43,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48600, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3315728293189659166_1337, duration: 279870
2013-10-31 18:43:43,003 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/groupgroup
2013-10-31 18:43:43,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup	dst=null	perm=null
2013-10-31 18:43:43,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000	dst=null	perm=null
2013-10-31 18:43:43,010 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51513, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3315728293189659166_1337, duration: 257490
2013-10-31 18:43:43,029 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:43:43,030 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:43:43,054 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] starting
2013-10-31 18:43:43,055 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:43:43,055 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup"]
2013-10-31 18:43:43,055 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset]  parallel execution is enabled: true
2013-10-31 18:43:43,055 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset]  starting jobs: 2
2013-10-31 18:43:43,056 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset]  allocating threads: 2
2013-10-31 18:43:43,057 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] starting step: (2/2)
2013-10-31 18:43:43,060 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:43:43,060 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:43:43,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:43,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:43:43,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,079 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar. blk_-4551812382357065300_1339
2013-10-31 18:43:43,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:51514 dest: /127.0.0.1:34578
2013-10-31 18:43:43,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:44712 dest: /127.0.0.1:59471
2013-10-31 18:43:43,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:48604 dest: /127.0.0.1:37740
2013-10-31 18:43:43,094 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48604, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4551812382357065300_1339, duration: 6599486
2013-10-31 18:43:43,094 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4551812382357065300_1339 terminating
2013-10-31 18:43:43,094 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:43,094 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44712, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4551812382357065300_1339, duration: 7419260
2013-10-31 18:43:43,095 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4551812382357065300_1339 terminating
2013-10-31 18:43:43,096 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51514, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4551812382357065300_1339, duration: 8539777
2013-10-31 18:43:43,096 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4551812382357065300_1339 terminating
2013-10-31 18:43:43,098 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:43,098 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar from client DFSClient_-1596270109
2013-10-31 18:43:43,099 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:43:43,099 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:43,104 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar. New replication is 10
2013-10-31 18:43:43,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar	dst=null	perm=null
2013-10-31 18:43:43,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,118 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:43:43,123 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:43:43,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:43:43,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,140 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split. New replication is 10
2013-10-31 18:43:43,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=null
2013-10-31 18:43:43,148 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split. blk_1454396135264491716_1340
2013-10-31 18:43:43,149 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:44714 dest: /127.0.0.1:59471
2013-10-31 18:43:43,151 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:48606 dest: /127.0.0.1:37740
2013-10-31 18:43:43,153 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:48890 dest: /127.0.0.1:54365
2013-10-31 18:43:43,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:51520 dest: /127.0.0.1:34578
2013-10-31 18:43:43,158 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51520, dest: /127.0.0.1:34578, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1454396135264491716_1340, duration: 117442
2013-10-31 18:43:43,158 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,158 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48890, dest: /127.0.0.1:54365, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1454396135264491716_1340, duration: 930966
2013-10-31 18:43:43,159 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48606, dest: /127.0.0.1:37740, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1454396135264491716_1340, duration: 2088779
2013-10-31 18:43:43,160 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,160 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44714, dest: /127.0.0.1:59471, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1454396135264491716_1340, duration: 2891340
2013-10-31 18:43:43,161 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,164 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,164 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split from client DFSClient_-1596270109
2013-10-31 18:43:43,165 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split is closed by DFSClient_-1596270109
2013-10-31 18:43:43,165 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,165 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,571 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-4551812382357065300_1339 to datanode(s) 127.0.0.1:54365
2013-10-31 18:43:43,572 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5135335180789234108_1336 blk_1107095905103096836_1328 blk_5794936352752417851_1333 blk_-2470905291057701022_1330 blk_-7533221922779966677_1331
2013-10-31 18:43:43,572 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_5135335180789234108_1336 blk_5204921068052043086_1329 blk_-6329593982662489296_1326
2013-10-31 18:43:43,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,634 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo. blk_-8305809994108552517_1341
2013-10-31 18:43:43,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8305809994108552517_1341 src: /127.0.0.1:48609 dest: /127.0.0.1:37740
2013-10-31 18:43:43,637 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8305809994108552517_1341 src: /127.0.0.1:48893 dest: /127.0.0.1:54365
2013-10-31 18:43:43,639 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8305809994108552517_1341 src: /127.0.0.1:51523 dest: /127.0.0.1:34578
2013-10-31 18:43:43,642 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51523, dest: /127.0.0.1:34578, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8305809994108552517_1341, duration: 66135
2013-10-31 18:43:43,642 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8305809994108552517_1341 terminating
2013-10-31 18:43:43,642 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8305809994108552517_1341 size 183
2013-10-31 18:43:43,643 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48893, dest: /127.0.0.1:54365, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8305809994108552517_1341, duration: 854426
2013-10-31 18:43:43,643 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8305809994108552517_1341 terminating
2013-10-31 18:43:43,644 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48609, dest: /127.0.0.1:37740, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8305809994108552517_1341, duration: 1804089
2013-10-31 18:43:43,644 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8305809994108552517_1341 terminating
2013-10-31 18:43:43,644 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8305809994108552517_1341 size 183
2013-10-31 18:43:43,647 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:43:43,647 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:43:43,647 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8305809994108552517_1341 size 183
2013-10-31 18:43:43,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,674 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml. blk_5164439424888837899_1342
2013-10-31 18:43:43,675 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5164439424888837899_1342 src: /127.0.0.1:48895 dest: /127.0.0.1:54365
2013-10-31 18:43:43,677 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5164439424888837899_1342 src: /127.0.0.1:48613 dest: /127.0.0.1:37740
2013-10-31 18:43:43,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5164439424888837899_1342 src: /127.0.0.1:44723 dest: /127.0.0.1:59471
2013-10-31 18:43:43,681 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44723, dest: /127.0.0.1:59471, bytes: 28182, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5164439424888837899_1342, duration: 215264
2013-10-31 18:43:43,682 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5164439424888837899_1342 terminating
2013-10-31 18:43:43,682 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5164439424888837899_1342 size 28182
2013-10-31 18:43:43,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48613, dest: /127.0.0.1:37740, bytes: 28182, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5164439424888837899_1342, duration: 1039183
2013-10-31 18:43:43,683 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5164439424888837899_1342 terminating
2013-10-31 18:43:43,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48895, dest: /127.0.0.1:54365, bytes: 28182, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 2114181
2013-10-31 18:43:43,684 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5164439424888837899_1342 terminating
2013-10-31 18:43:43,684 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5164439424888837899_1342 size 28182
2013-10-31 18:43:43,686 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml from client DFSClient_-1596270109
2013-10-31 18:43:43,687 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:43:43,687 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5164439424888837899_1342 size 28182
2013-10-31 18:43:43,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml	dst=null	perm=null
2013-10-31 18:43:43,707 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48899, bytes: 28406, op: HDFS_READ, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 422992
2013-10-31 18:43:43,725 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0034: nMaps=5 nReduces=1 max=-1
2013-10-31 18:43:43,725 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0034 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:43:43,725 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0034
2013-10-31 18:43:43,726 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0034	RESULT=SUCCESS
2013-10-31 18:43:43,726 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0034
2013-10-31 18:43:43,727 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] submitted hadoop job: job_20131031182606197_0034
2013-10-31 18:43:43,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,759 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml. blk_7916561388913392372_1344
2013-10-31 18:43:43,760 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7916561388913392372_1344 src: /127.0.0.1:48900 dest: /127.0.0.1:54365
2013-10-31 18:43:43,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7916561388913392372_1344 src: /127.0.0.1:51530 dest: /127.0.0.1:34578
2013-10-31 18:43:43,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7916561388913392372_1344 src: /127.0.0.1:48619 dest: /127.0.0.1:37740
2013-10-31 18:43:43,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48619, dest: /127.0.0.1:37740, bytes: 28247, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7916561388913392372_1344, duration: 533200
2013-10-31 18:43:43,768 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7916561388913392372_1344 terminating
2013-10-31 18:43:43,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51530, dest: /127.0.0.1:34578, bytes: 28247, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7916561388913392372_1344, duration: 1376942
2013-10-31 18:43:43,769 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7916561388913392372_1344 terminating
2013-10-31 18:43:43,769 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48900, dest: /127.0.0.1:54365, bytes: 28247, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7916561388913392372_1344, duration: 2254969
2013-10-31 18:43:43,770 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7916561388913392372_1344 terminating
2013-10-31 18:43:43,773 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7916561388913392372_1344 size 28247
2013-10-31 18:43:43,773 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml from client DFSClient_2033320963
2013-10-31 18:43:43,774 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml is closed by DFSClient_2033320963
2013-10-31 18:43:43,774 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7916561388913392372_1344 size 28247
2013-10-31 18:43:43,774 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7916561388913392372_1344 size 28247
2013-10-31 18:43:43,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,786 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken. blk_-4548667154538039926_1345
2013-10-31 18:43:43,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4548667154538039926_1345 src: /127.0.0.1:48620 dest: /127.0.0.1:37740
2013-10-31 18:43:43,789 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4548667154538039926_1345 src: /127.0.0.1:48904 dest: /127.0.0.1:54365
2013-10-31 18:43:43,791 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4548667154538039926_1345 src: /127.0.0.1:44731 dest: /127.0.0.1:59471
2013-10-31 18:43:43,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44731, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4548667154538039926_1345, duration: 91236
2013-10-31 18:43:43,794 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4548667154538039926_1345 terminating
2013-10-31 18:43:43,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48904, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4548667154538039926_1345, duration: 954910
2013-10-31 18:43:43,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4548667154538039926_1345 terminating
2013-10-31 18:43:43,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48620, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4548667154538039926_1345, duration: 1809353
2013-10-31 18:43:43,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4548667154538039926_1345 size 116
2013-10-31 18:43:43,796 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4548667154538039926_1345 terminating
2013-10-31 18:43:43,798 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4548667154538039926_1345 size 116
2013-10-31 18:43:43,799 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4548667154538039926_1345 size 116
2013-10-31 18:43:43,800 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken from client DFSClient_-1596270109
2013-10-31 18:43:43,800 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:43:43,805 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken
2013-10-31 18:43:43,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:43:43,809 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48906, bytes: 187, op: HDFS_READ, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8305809994108552517_1341, duration: 279212
2013-10-31 18:43:43,811 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0034 = 19. Number of splits = 5
2013-10-31 18:43:43,811 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,811 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,814 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,814 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,814 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,815 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,815 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0034 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:43:43,815 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0034 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 18:43:44,983 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data5/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:44,983 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data6/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:44,983 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data5/current/blk_-7533221922779966677
2013-10-31 18:43:44,983 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1107095905103096836_1328 file build/test/data/dfs/data/data5/current/blk_1107095905103096836 for deletion
2013-10-31 18:43:44,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data6/current/blk_-2470905291057701022
2013-10-31 18:43:44,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1107095905103096836_1328 at file build/test/data/dfs/data/data5/current/blk_1107095905103096836
2013-10-31 18:43:44,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5135335180789234108_1336 file build/test/data/dfs/data/data6/current/blk_5135335180789234108 for deletion
2013-10-31 18:43:44,984 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5794936352752417851_1333 file build/test/data/dfs/data/data6/current/blk_5794936352752417851 for deletion
2013-10-31 18:43:44,985 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5135335180789234108_1336 at file build/test/data/dfs/data/data6/current/blk_5135335180789234108
2013-10-31 18:43:44,985 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5794936352752417851_1333 at file build/test/data/dfs/data/data6/current/blk_5794936352752417851
2013-10-31 18:43:45,379 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-4551812382357065300_1339 to 127.0.0.1:54365 
2013-10-31 18:43:45,382 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:48908 dest: /127.0.0.1:54365
2013-10-31 18:43:45,382 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-4551812382357065300_1339 to /127.0.0.1:54365
2013-10-31 18:43:45,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4551812382357065300_1339 src: /127.0.0.1:48908 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:43:45,388 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:45,452 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6329593982662489296_1326 file build/test/data/dfs/data/data7/current/blk_-6329593982662489296 for deletion
2013-10-31 18:43:45,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5135335180789234108_1336 file build/test/data/dfs/data/data7/current/blk_5135335180789234108 for deletion
2013-10-31 18:43:45,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6329593982662489296_1326 at file build/test/data/dfs/data/data7/current/blk_-6329593982662489296
2013-10-31 18:43:45,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5204921068052043086_1329 file build/test/data/dfs/data/data7/current/blk_5204921068052043086 for deletion
2013-10-31 18:43:45,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5135335180789234108_1336 at file build/test/data/dfs/data/data7/current/blk_5135335180789234108
2013-10-31 18:43:45,453 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5204921068052043086_1329 at file build/test/data/dfs/data/data7/current/blk_5204921068052043086
2013-10-31 18:43:45,764 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0034_m_000006_0' to tip task_20131031182606197_0034_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:45,770 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:43:45,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000006_0 which needs 1 slots
2013-10-31 18:43:45,770 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:45,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000006_0 which needs 1 slots
2013-10-31 18:43:45,770 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0033 being deleted.
2013-10-31 18:43:45,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken	dst=null	perm=null
2013-10-31 18:43:45,779 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48626, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4548667154538039926_1345, duration: 421360
2013-10-31 18:43:45,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml	dst=null	perm=null
2013-10-31 18:43:45,789 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48911, bytes: 28406, op: HDFS_READ, cliID: DFSClient_-2090601293, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 380164
2013-10-31 18:43:45,819 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:45,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar	dst=null	perm=null
2013-10-31 18:43:45,845 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48912, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2090601293, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4551812382357065300_1339, duration: 1210442
2013-10-31 18:43:45,941 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_-950639163
2013-10-31 18:43:45,941 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_-950639163 spawned.
2013-10-31 18:43:45,944 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000006_0/taskjvm.sh
2013-10-31 18:43:46,573 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1107095905103096836_1328 blk_-2470905291057701022_1330 blk_5204921068052043086_1329 blk_-7533221922779966677_1331 blk_7520970391311344253_1332 blk_-6329593982662489296_1326
2013-10-31 18:43:46,573 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5135335180789234108_1336 blk_1107095905103096836_1328 blk_5204921068052043086_1329 blk_-6329593982662489296_1326
2013-10-31 18:43:47,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6329593982662489296_1326 file build/test/data/dfs/data/data3/current/blk_-6329593982662489296 for deletion
2013-10-31 18:43:47,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1107095905103096836_1328 file build/test/data/dfs/data/data3/current/blk_1107095905103096836 for deletion
2013-10-31 18:43:47,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6329593982662489296_1326 at file build/test/data/dfs/data/data3/current/blk_-6329593982662489296
2013-10-31 18:43:47,254 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5135335180789234108_1336 file build/test/data/dfs/data/data4/current/blk_5135335180789234108 for deletion
2013-10-31 18:43:47,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1107095905103096836_1328 at file build/test/data/dfs/data/data3/current/blk_1107095905103096836
2013-10-31 18:43:47,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5204921068052043086_1329 file build/test/data/dfs/data/data4/current/blk_5204921068052043086 for deletion
2013-10-31 18:43:47,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5135335180789234108_1336 at file build/test/data/dfs/data/data4/current/blk_5135335180789234108
2013-10-31 18:43:47,255 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5204921068052043086_1329 at file build/test/data/dfs/data/data4/current/blk_5204921068052043086
2013-10-31 18:43:47,515 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-950639163 given task: attempt_20131031182606197_0034_m_000006_0
2013-10-31 18:43:47,813 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:47,813 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0033_m_000001_0 not found in cache
2013-10-31 18:43:47,813 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383331427813
2013-10-31 18:43:47,827 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0033_r_103233333 since job job_20131031182606197_0033 is dead
2013-10-31 18:43:47,832 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3642 with signal TERM. Exit code 0
2013-10-31 18:43:47,985 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:47,985 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:47,985 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:47,985 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0033_r_103233333 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:48,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:48,381 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data1/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:48,381 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6329593982662489296_1326 file build/test/data/dfs/data/data1/current/blk_-6329593982662489296 for deletion
2013-10-31 18:43:48,381 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data1/current/blk_-7533221922779966677
2013-10-31 18:43:48,381 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data2/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:48,382 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6329593982662489296_1326 at file build/test/data/dfs/data/data1/current/blk_-6329593982662489296
2013-10-31 18:43:48,382 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1107095905103096836_1328 file build/test/data/dfs/data/data2/current/blk_1107095905103096836 for deletion
2013-10-31 18:43:48,382 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data2/current/blk_-2470905291057701022
2013-10-31 18:43:48,382 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5204921068052043086_1329 file build/test/data/dfs/data/data1/current/blk_5204921068052043086 for deletion
2013-10-31 18:43:48,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1107095905103096836_1328 at file build/test/data/dfs/data/data2/current/blk_1107095905103096836
2013-10-31 18:43:48,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7520970391311344253_1332 file build/test/data/dfs/data/data2/current/blk_7520970391311344253 for deletion
2013-10-31 18:43:48,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5204921068052043086_1329 at file build/test/data/dfs/data/data1/current/blk_5204921068052043086
2013-10-31 18:43:48,383 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7520970391311344253_1332 at file build/test/data/dfs/data/data2/current/blk_7520970391311344253
2013-10-31 18:43:48,926 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0033_m_317850141 since job job_20131031182606197_0033 is dead
2013-10-31 18:43:48,937 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3318 with signal TERM. Exit code 0
2013-10-31 18:43:49,100 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0033_m_1954828324 since job job_20131031182606197_0033 is dead
2013-10-31 18:43:49,111 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3529 with signal TERM. Exit code 0
2013-10-31 18:43:49,152 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:49,152 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:49,152 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:49,152 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0033_m_317850141 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:43:49,336 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:49,336 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:49,336 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:43:49,336 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0033_m_1954828324 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:50,978 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000006_0 0.0% setup
2013-10-31 18:43:50,981 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000006_0 is done.
2013-10-31 18:43:50,982 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000006_0  was -1
2013-10-31 18:43:50,982 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:51,776 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000006_0' has completed task_20131031182606197_0034_m_000006 successfully.
2013-10-31 18:43:51,780 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000000_0' to tip task_20131031182606197_0034_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:51,781 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000000
2013-10-31 18:43:51,781 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000001_0' to tip task_20131031182606197_0034_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:51,782 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000001
2013-10-31 18:43:51,784 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:51,785 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:43:51,785 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000000_0 which needs 1 slots
2013-10-31 18:43:51,785 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000000_0 which needs 1 slots
2013-10-31 18:43:51,786 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000001_0 which needs 1 slots
2013-10-31 18:43:51,786 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0034_m_000001_0 which needs 1 slots
2013-10-31 18:43:51,820 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_-1745551915
2013-10-31 18:43:51,820 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_-1745551915 spawned.
2013-10-31 18:43:51,821 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000002_0' to tip task_20131031182606197_0034_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:51,821 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0034/attempt_20131031182606197_0034_m_000000_0. Attempting to reuse: jvm_20131031182606197_0034_m_-950639163
2013-10-31 18:43:51,821 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000002
2013-10-31 18:43:51,822 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000003_0' to tip task_20131031182606197_0034_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:51,822 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000003
2013-10-31 18:43:51,822 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000001_0/taskjvm.sh
2013-10-31 18:43:51,823 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:43:51,823 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:43:51,823 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000002_0 which needs 1 slots
2013-10-31 18:43:51,823 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000002_0 which needs 1 slots
2013-10-31 18:43:51,824 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000003_0 which needs 1 slots
2013-10-31 18:43:51,824 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0034_m_000003_0 which needs 1 slots
2013-10-31 18:43:51,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken	dst=null	perm=null
2013-10-31 18:43:51,827 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44741, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4548667154538039926_1345, duration: 142342
2013-10-31 18:43:51,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml	dst=null	perm=null
2013-10-31 18:43:51,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48634, bytes: 28406, op: HDFS_READ, cliID: DFSClient_-106590138, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5164439424888837899_1342, duration: 161156
2013-10-31 18:43:51,852 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:51,859 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000004_0' to tip task_20131031182606197_0034_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:43:51,860 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000004
2013-10-31 18:43:51,861 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:43:51,861 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000004_0 which needs 1 slots
2013-10-31 18:43:51,862 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000004_0 which needs 1 slots
2013-10-31 18:43:51,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken	dst=null	perm=null
2013-10-31 18:43:51,867 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48635, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4548667154538039926_1345, duration: 139179
2013-10-31 18:43:51,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml	dst=null	perm=null
2013-10-31 18:43:51,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48920, bytes: 28406, op: HDFS_READ, cliID: DFSClient_23976491, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 158098
2013-10-31 18:43:51,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar	dst=null	perm=null
2013-10-31 18:43:51,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48638, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-106590138, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4551812382357065300_1339, duration: 611620
2013-10-31 18:43:51,902 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:51,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar	dst=null	perm=null
2013-10-31 18:43:51,916 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48922, bytes: 239915, op: HDFS_READ, cliID: DFSClient_23976491, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4551812382357065300_1339, duration: 587547
2013-10-31 18:43:51,944 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_921467046
2013-10-31 18:43:51,945 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_921467046 spawned.
2013-10-31 18:43:51,945 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_1100073729
2013-10-31 18:43:51,946 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_1100073729 spawned.
2013-10-31 18:43:51,947 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000003_0/taskjvm.sh
2013-10-31 18:43:51,947 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000002_0/taskjvm.sh
2013-10-31 18:43:51,969 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_1359958609
2013-10-31 18:43:51,969 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_1359958609 spawned.
2013-10-31 18:43:51,970 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000004_0/taskjvm.sh
2013-10-31 18:43:52,045 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-950639163 given task: attempt_20131031182606197_0034_m_000000_0
2013-10-31 18:43:52,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=null
2013-10-31 18:43:52,165 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44750, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1454396135264491716_1340, duration: 171281
2013-10-31 18:43:52,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:43:52,493 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48925, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 292363
2013-10-31 18:43:53,933 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-1745551915 given task: attempt_20131031182606197_0034_m_000001_0
2013-10-31 18:43:53,968 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_921467046 given task: attempt_20131031182606197_0034_m_000003_0
2013-10-31 18:43:53,980 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_1100073729 given task: attempt_20131031182606197_0034_m_000002_0
2013-10-31 18:43:54,011 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_1359958609 given task: attempt_20131031182606197_0034_m_000004_0
2013-10-31 18:43:54,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=null
2013-10-31 18:43:54,447 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51561, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1454396135264491716_1340, duration: 168081
2013-10-31 18:43:54,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=null
2013-10-31 18:43:54,470 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48934, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1454396135264491716_1340, duration: 223464
2013-10-31 18:43:54,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:43:54,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48652, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 111967
2013-10-31 18:43:54,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:43:54,511 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44763, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 140861
2013-10-31 18:43:54,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=null
2013-10-31 18:43:54,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48655, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000004_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1454396135264491716_1340, duration: 208068
2013-10-31 18:43:54,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:43:54,573 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48939, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 170311
2013-10-31 18:43:54,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split	dst=null	perm=null
2013-10-31 18:43:54,581 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51569, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1454396135264491716_1340, duration: 140307
2013-10-31 18:43:54,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:43:54,623 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48942, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 137870
2013-10-31 18:43:55,129 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+4
2013-10-31 18:43:55,133 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000000_0 is done.
2013-10-31 18:43:55,133 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000000_0  was 40
2013-10-31 18:43:55,134 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:43:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:43:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,038 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,043 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,043 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:43:56,785 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0034_m_000006_0
2013-10-31 18:43:56,786 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0034_m_000006_0
2013-10-31 18:43:56,786 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0034_m_000006_0 not found in cache
2013-10-31 18:43:57,377 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:4+4
2013-10-31 18:43:57,380 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000001_0 is done.
2013-10-31 18:43:57,380 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000001_0  was 40
2013-10-31 18:43:57,380 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:57,401 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:12+4
2013-10-31 18:43:57,403 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000003_0 is done.
2013-10-31 18:43:57,403 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000003_0  was 40
2013-10-31 18:43:57,404 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:43:57,462 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000004_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:16+3
2013-10-31 18:43:57,464 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000004_0 is done.
2013-10-31 18:43:57,465 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000004_0  was 40
2013-10-31 18:43:57,465 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:57,511 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:8+4
2013-10-31 18:43:57,513 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000002_0 is done.
2013-10-31 18:43:57,513 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000002_0  was 40
2013-10-31 18:43:57,514 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:57,789 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000000_0' has completed task_20131031182606197_0034_m_000000 successfully.
2013-10-31 18:43:57,790 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000001_0' has completed task_20131031182606197_0034_m_000001 successfully.
2013-10-31 18:43:57,792 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0034_r_000000_0' to tip task_20131031182606197_0034_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:57,795 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:57,795 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_r_000000_0 which needs 1 slots
2013-10-31 18:43:57,795 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_r_000000_0 which needs 1 slots
2013-10-31 18:43:57,829 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000002_0' has completed task_20131031182606197_0034_m_000002 successfully.
2013-10-31 18:43:57,831 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000003_0' has completed task_20131031182606197_0034_m_000003 successfully.
2013-10-31 18:43:57,833 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_r_-710253377
2013-10-31 18:43:57,834 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_r_-710253377 spawned.
2013-10-31 18:43:57,838 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_r_000000_0/taskjvm.sh
2013-10-31 18:43:57,866 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000004_0' has completed task_20131031182606197_0034_m_000004 successfully.
2013-10-31 18:43:58,672 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_r_-710253377 given task: attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:04,376 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40955, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000000_0, duration: 7426341
2013-10-31 18:44:04,397 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40955, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000001_0, duration: 8284013
2013-10-31 18:44:04,414 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42977, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000002_0, duration: 12365338
2013-10-31 18:44:04,429 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42977, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000003_0, duration: 11332046
2013-10-31 18:44:04,446 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50612, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000004_0, duration: 11917580
2013-10-31 18:44:05,164 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:05,238 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:05,291 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:05,476 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1809 Total time for transactions(ms): 33Number of transactions batched in Syncs: 149 Number of syncs: 1271 SyncTimes(ms): 78497 18156 
2013-10-31 18:44:05,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:05,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:05,520 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000. blk_5157468367762981491_1346
2013-10-31 18:44:05,548 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5157468367762981491_1346 src: /127.0.0.1:48665 dest: /127.0.0.1:37740
2013-10-31 18:44:05,550 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5157468367762981491_1346 src: /127.0.0.1:51578 dest: /127.0.0.1:34578
2013-10-31 18:44:05,551 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5157468367762981491_1346 src: /127.0.0.1:44776 dest: /127.0.0.1:59471
2013-10-31 18:44:05,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44776, dest: /127.0.0.1:59471, bytes: 290, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0034_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5157468367762981491_1346, duration: 2000999
2013-10-31 18:44:05,555 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5157468367762981491_1346 terminating
2013-10-31 18:44:05,555 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5157468367762981491_1346 size 290
2013-10-31 18:44:05,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51578, dest: /127.0.0.1:34578, bytes: 290, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0034_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5157468367762981491_1346, duration: 2686587
2013-10-31 18:44:05,556 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5157468367762981491_1346 size 290
2013-10-31 18:44:05,556 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5157468367762981491_1346 terminating
2013-10-31 18:44:05,556 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48665, dest: /127.0.0.1:37740, bytes: 290, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0034_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5157468367762981491_1346, duration: 3240459
2013-10-31 18:44:05,556 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5157468367762981491_1346 terminating
2013-10-31 18:44:05,559 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:05,559 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:05,559 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5157468367762981491_1346 size 290
2013-10-31 18:44:05,595 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0034_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:44:05,596 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:06,805 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   5 OK for attempt_20131031182606197_0034_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:44:06,806 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:07,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0	dst=null	perm=null
2013-10-31 18:44:07,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:07,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:07,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0	dst=null	perm=null
2013-10-31 18:44:08,212 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:08,214 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:08,215 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_r_000000_0 is done.
2013-10-31 18:44:08,215 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_r_000000_0  was -1
2013-10-31 18:44:08,216 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:09,482 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7711436382493962850_1126
2013-10-31 18:44:09,810 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_r_000000_0' has completed task_20131031182606197_0034_r_000000 successfully.
2013-10-31 18:44:09,813 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0034_m_000005_0' to tip task_20131031182606197_0034_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:09,815 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:44:09,816 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000005_0 which needs 1 slots
2013-10-31 18:44:09,816 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000005_0 which needs 1 slots
2013-10-31 18:44:09,854 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0034/attempt_20131031182606197_0034_m_000005_0. Attempting to reuse: jvm_20131031182606197_0034_m_-1745551915
2013-10-31 18:44:10,168 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-1745551915 given task: attempt_20131031182606197_0034_m_000005_0
2013-10-31 18:44:10,300 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000005_0 0.0% 
2013-10-31 18:44:10,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary	dst=null	perm=null
2013-10-31 18:44:10,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:10,319 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_SUCCESS from client DFSClient_attempt_20131031182606197_0034_m_000005_0
2013-10-31 18:44:10,319 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0034_m_000005_0
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8305809994108552517 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:10,324 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8305809994108552517 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,325 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8305809994108552517 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,325 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5164439424888837899 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:10,325 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5164439424888837899 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,325 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5164439424888837899 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034	dst=null	perm=null
2013-10-31 18:44:10,484 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-4203961431443320417_1020
2013-10-31 18:44:10,577 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-4551812382357065300_1339 blk_-8305809994108552517_1341 blk_1454396135264491716_1340
2013-10-31 18:44:10,578 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-4551812382357065300_1339 blk_-8305809994108552517_1341 blk_5164439424888837899_1342 blk_1454396135264491716_1340
2013-10-31 18:44:12,003 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 16
2013-10-31 18:44:12,389 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8305809994108552517_1341 file build/test/data/dfs/data/data1/current/blk_-8305809994108552517 for deletion
2013-10-31 18:44:12,389 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data1/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:12,389 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8305809994108552517_1341 at file build/test/data/dfs/data/data1/current/blk_-8305809994108552517
2013-10-31 18:44:12,389 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data2/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:12,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data1/current/blk_-4551812382357065300
2013-10-31 18:44:12,390 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data2/current/blk_1454396135264491716
2013-10-31 18:44:12,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8305809994108552517_1341 file build/test/data/dfs/data/data8/current/blk_-8305809994108552517 for deletion
2013-10-31 18:44:12,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data8/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:12,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8305809994108552517_1341 at file build/test/data/dfs/data/data8/current/blk_-8305809994108552517
2013-10-31 18:44:12,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data7/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:12,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data8/current/blk_-4551812382357065300
2013-10-31 18:44:12,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data7/current/blk_1454396135264491716
2013-10-31 18:44:12,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5164439424888837899_1342 file build/test/data/dfs/data/data7/current/blk_5164439424888837899 for deletion
2013-10-31 18:44:12,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5164439424888837899_1342 at file build/test/data/dfs/data/data7/current/blk_5164439424888837899
2013-10-31 18:44:13,249 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000005_0 0.0% cleanup
2013-10-31 18:44:13,250 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000005_0 is done.
2013-10-31 18:44:13,251 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000005_0  was -1
2013-10-31 18:44:13,251 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:13,578 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-4551812382357065300_1339 blk_-8305809994108552517_1341 blk_5164439424888837899_1342 blk_1454396135264491716_1340
2013-10-31 18:44:13,578 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-4551812382357065300_1339 blk_5164439424888837899_1342 blk_1454396135264491716_1340
2013-10-31 18:44:14,264 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8305809994108552517_1341 file build/test/data/dfs/data/data3/current/blk_-8305809994108552517 for deletion
2013-10-31 18:44:14,264 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data3/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:14,264 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8305809994108552517_1341 at file build/test/data/dfs/data/data3/current/blk_-8305809994108552517
2013-10-31 18:44:14,264 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data4/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:14,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data3/current/blk_-4551812382357065300
2013-10-31 18:44:14,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data4/current/blk_1454396135264491716
2013-10-31 18:44:14,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5164439424888837899_1342 file build/test/data/dfs/data/data4/current/blk_5164439424888837899 for deletion
2013-10-31 18:44:14,266 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5164439424888837899_1342 at file build/test/data/dfs/data/data4/current/blk_5164439424888837899
2013-10-31 18:44:14,816 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:14,816 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:14,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data6/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:14,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data5/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:14,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data6/current/blk_-4551812382357065300
2013-10-31 18:44:14,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data5/current/blk_1454396135264491716
2013-10-31 18:44:14,993 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5164439424888837899_1342 file build/test/data/dfs/data/data6/current/blk_5164439424888837899 for deletion
2013-10-31 18:44:14,994 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5164439424888837899_1342 at file build/test/data/dfs/data/data6/current/blk_5164439424888837899
2013-10-31 18:44:15,823 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000005_0' has completed task_20131031182606197_0034_m_000005 successfully.
2013-10-31 18:44:15,824 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0034 has completed successfully.
2013-10-31 18:44:15,824 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0034,submitTime=1383245023693,launchTime=1383245023815,firstMapTaskLaunchTime=1383245031779,firstReduceTaskLaunchTime=1383245037792,firstJobSetupTaskLaunchTime=1383245025763,firstJobCleanupTaskLaunchTime=1383245049812,finishTime=1383245055824,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[CE7497985D0148D183840F8CF65154C9/3EE2A0E4707244D4AD91EAD51ADE1822] lower+upper+offset/(2/2)
2013-10-31 18:44:15,829 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4. blk_-5199617541030467941_1347
2013-10-31 18:44:15,831 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5199617541030467941_1347 src: /127.0.0.1:48671 dest: /127.0.0.1:37740
2013-10-31 18:44:15,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5199617541030467941_1347 src: /127.0.0.1:44781 dest: /127.0.0.1:59471
2013-10-31 18:44:15,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5199617541030467941_1347 src: /127.0.0.1:48956 dest: /127.0.0.1:54365
2013-10-31 18:44:15,842 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48956, dest: /127.0.0.1:54365, bytes: 32004, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5199617541030467941_1347, duration: 4270997
2013-10-31 18:44:15,843 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5199617541030467941_1347 terminating
2013-10-31 18:44:15,843 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44781, dest: /127.0.0.1:59471, bytes: 32004, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5199617541030467941_1347, duration: 5734869
2013-10-31 18:44:15,845 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5199617541030467941_1347 terminating
2013-10-31 18:44:15,845 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5199617541030467941_1347 size 32004
2013-10-31 18:44:15,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48671, dest: /127.0.0.1:37740, bytes: 32004, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5199617541030467941_1347, duration: 7467963
2013-10-31 18:44:15,846 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5199617541030467941_1347 size 32004
2013-10-31 18:44:15,846 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5199617541030467941_1347 terminating
2013-10-31 18:44:15,849 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 from client DFSClient_2033320963
2013-10-31 18:44:15,849 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 is closed by DFSClient_2033320963
2013-10-31 18:44:15,849 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5199617541030467941_1347 size 32004
2013-10-31 18:44:15,855 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:15,855 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000000_0'
2013-10-31 18:44:15,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000001_0'
2013-10-31 18:44:15,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000005_0'
2013-10-31 18:44:15,856 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000006_0'
2013-10-31 18:44:15,857 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_r_000000_0'
2013-10-31 18:44:15,857 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4548667154538039926 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:15,857 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4548667154538039926 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:15,857 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4548667154538039926 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:15,857 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000002_0'
2013-10-31 18:44:15,858 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000003_0'
2013-10-31 18:44:15,861 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0034_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:15,861 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] starting step: (1/2) .../samemergethreechaingroup
2013-10-31 18:44:15,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034	dst=null	perm=null
2013-10-31 18:44:15,866 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:44:15,866 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:44:15,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:15,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:44:15,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,887 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar. blk_-9197354684127990610_1348
2013-10-31 18:44:15,888 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:51587 dest: /127.0.0.1:34578
2013-10-31 18:44:15,889 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:44785 dest: /127.0.0.1:59471
2013-10-31 18:44:15,890 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:48677 dest: /127.0.0.1:37740
2013-10-31 18:44:15,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48677, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9197354684127990610_1348, duration: 3300778
2013-10-31 18:44:15,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9197354684127990610_1348 terminating
2013-10-31 18:44:15,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44785, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9197354684127990610_1348, duration: 2854036
2013-10-31 18:44:15,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9197354684127990610_1348 terminating
2013-10-31 18:44:15,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51587, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9197354684127990610_1348, duration: 3810611
2013-10-31 18:44:15,895 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9197354684127990610_1348 terminating
2013-10-31 18:44:15,897 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:15,897 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar from client DFSClient_-1596270109
2013-10-31 18:44:15,898 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:44:15,898 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:15,898 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:15,903 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar. New replication is 10
2013-10-31 18:44:15,906 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000004_0'
2013-10-31 18:44:15,907 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:15,907 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0034 being deleted.
2013-10-31 18:44:15,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar	dst=null	perm=null
2013-10-31 18:44:15,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,917 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:44:15,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1	dst=null	perm=null
2013-10-31 18:44:15,921 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000	dst=null	perm=null
2013-10-31 18:44:15,923 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:15,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1	dst=null	perm=null
2013-10-31 18:44:15,926 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000	dst=null	perm=null
2013-10-31 18:44:15,928 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:15,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,940 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split. New replication is 10
2013-10-31 18:44:15,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:15,946 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split. blk_-3425796593221907686_1349
2013-10-31 18:44:15,947 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:51590 dest: /127.0.0.1:34578
2013-10-31 18:44:15,948 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:48679 dest: /127.0.0.1:37740
2013-10-31 18:44:15,949 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:48963 dest: /127.0.0.1:54365
2013-10-31 18:44:15,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:44790 dest: /127.0.0.1:59471
2013-10-31 18:44:15,953 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44790, dest: /127.0.0.1:59471, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3425796593221907686_1349, duration: 1136598
2013-10-31 18:44:15,953 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,953 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48963, dest: /127.0.0.1:54365, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3425796593221907686_1349, duration: 333402
2013-10-31 18:44:15,954 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,954 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,954 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48679, dest: /127.0.0.1:37740, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3425796593221907686_1349, duration: 1047666
2013-10-31 18:44:15,954 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,955 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,955 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51590, dest: /127.0.0.1:34578, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3425796593221907686_1349, duration: 2216818
2013-10-31 18:44:15,955 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,957 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split from client DFSClient_-1596270109
2013-10-31 18:44:15,957 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split is closed by DFSClient_-1596270109
2013-10-31 18:44:15,958 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,959 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,976 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo. blk_1024870396640826331_1350
2013-10-31 18:44:15,977 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1024870396640826331_1350 src: /127.0.0.1:44791 dest: /127.0.0.1:59471
2013-10-31 18:44:15,978 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1024870396640826331_1350 src: /127.0.0.1:51595 dest: /127.0.0.1:34578
2013-10-31 18:44:15,980 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1024870396640826331_1350 src: /127.0.0.1:48684 dest: /127.0.0.1:37740
2013-10-31 18:44:15,986 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48684, dest: /127.0.0.1:37740, bytes: 220, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1024870396640826331_1350, duration: 3463511
2013-10-31 18:44:15,987 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1024870396640826331_1350 terminating
2013-10-31 18:44:15,987 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51595, dest: /127.0.0.1:34578, bytes: 220, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1024870396640826331_1350, duration: 913609
2013-10-31 18:44:15,988 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1024870396640826331_1350 terminating
2013-10-31 18:44:15,988 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44791, dest: /127.0.0.1:59471, bytes: 220, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1024870396640826331_1350, duration: 1734247
2013-10-31 18:44:15,989 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1024870396640826331_1350 terminating
2013-10-31 18:44:15,991 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1024870396640826331_1350 size 220
2013-10-31 18:44:15,992 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1024870396640826331_1350 size 220
2013-10-31 18:44:15,993 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1024870396640826331_1350 size 220
2013-10-31 18:44:16,391 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:44:16,392 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:44:16,579 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-9197354684127990610_1348 to datanode(s) 127.0.0.1:54365
2013-10-31 18:44:16,580 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-4548667154538039926_1345
2013-10-31 18:44:16,580 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-4548667154538039926_1345
2013-10-31 18:44:16,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:16,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:16,903 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml. blk_3611869011102150252_1351
2013-10-31 18:44:16,905 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3611869011102150252_1351 src: /127.0.0.1:51597 dest: /127.0.0.1:34578
2013-10-31 18:44:16,907 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3611869011102150252_1351 src: /127.0.0.1:48686 dest: /127.0.0.1:37740
2013-10-31 18:44:16,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3611869011102150252_1351 src: /127.0.0.1:44796 dest: /127.0.0.1:59471
2013-10-31 18:44:16,911 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44796, dest: /127.0.0.1:59471, bytes: 28710, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3611869011102150252_1351, duration: 374655
2013-10-31 18:44:16,912 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3611869011102150252_1351 terminating
2013-10-31 18:44:16,912 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48686, dest: /127.0.0.1:37740, bytes: 28710, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3611869011102150252_1351, duration: 1247502
2013-10-31 18:44:16,913 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3611869011102150252_1351 terminating
2013-10-31 18:44:16,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51597, dest: /127.0.0.1:34578, bytes: 28710, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 2224789
2013-10-31 18:44:16,914 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3611869011102150252_1351 terminating
2013-10-31 18:44:16,918 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3611869011102150252_1351 size 28710
2013-10-31 18:44:16,919 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml from client DFSClient_-1596270109
2013-10-31 18:44:16,919 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:44:16,919 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3611869011102150252_1351 size 28710
2013-10-31 18:44:16,920 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3611869011102150252_1351 size 28710
2013-10-31 18:44:16,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml	dst=null	perm=null
2013-10-31 18:44:16,951 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51601, bytes: 28938, op: HDFS_READ, cliID: DFSClient_-858444681, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 453087
2013-10-31 18:44:16,971 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0035: nMaps=6 nReduces=1 max=-1
2013-10-31 18:44:16,972 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0035 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:44:16,972 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0035
2013-10-31 18:44:16,972 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0035	RESULT=SUCCESS
2013-10-31 18:44:16,972 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0035
2013-10-31 18:44:16,973 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] submitted hadoop job: job_20131031182606197_0035
2013-10-31 18:44:16,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:17,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:17,006 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml. blk_-8586261772825454961_1353
2013-10-31 18:44:17,008 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8586261772825454961_1353 src: /127.0.0.1:44799 dest: /127.0.0.1:59471
2013-10-31 18:44:17,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8586261772825454961_1353 src: /127.0.0.1:48974 dest: /127.0.0.1:54365
2013-10-31 18:44:17,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8586261772825454961_1353 src: /127.0.0.1:48692 dest: /127.0.0.1:37740
2013-10-31 18:44:17,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48692, dest: /127.0.0.1:37740, bytes: 28775, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8586261772825454961_1353, duration: 464924
2013-10-31 18:44:17,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8586261772825454961_1353 terminating
2013-10-31 18:44:17,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48974, dest: /127.0.0.1:54365, bytes: 28775, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8586261772825454961_1353, duration: 1931525
2013-10-31 18:44:17,016 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8586261772825454961_1353 terminating
2013-10-31 18:44:17,017 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44799, dest: /127.0.0.1:59471, bytes: 28775, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8586261772825454961_1353, duration: 2200194
2013-10-31 18:44:17,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8586261772825454961_1353 terminating
2013-10-31 18:44:17,021 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8586261772825454961_1353 size 28775
2013-10-31 18:44:17,022 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml from client DFSClient_-858444681
2013-10-31 18:44:17,022 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml is closed by DFSClient_-858444681
2013-10-31 18:44:17,022 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8586261772825454961_1353 size 28775
2013-10-31 18:44:17,023 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8586261772825454961_1353 size 28775
2013-10-31 18:44:17,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:17,036 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken. blk_-8829734083624927549_1354
2013-10-31 18:44:17,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8829734083624927549_1354 src: /127.0.0.1:48693 dest: /127.0.0.1:37740
2013-10-31 18:44:17,039 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8829734083624927549_1354 src: /127.0.0.1:44803 dest: /127.0.0.1:59471
2013-10-31 18:44:17,041 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8829734083624927549_1354 src: /127.0.0.1:51607 dest: /127.0.0.1:34578
2013-10-31 18:44:17,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51607, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8829734083624927549_1354, duration: 71660
2013-10-31 18:44:17,044 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8829734083624927549_1354 terminating
2013-10-31 18:44:17,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44803, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8829734083624927549_1354, duration: 875780
2013-10-31 18:44:17,045 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8829734083624927549_1354 terminating
2013-10-31 18:44:17,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48693, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8829734083624927549_1354, duration: 1773854
2013-10-31 18:44:17,046 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8829734083624927549_1354 terminating
2013-10-31 18:44:17,046 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8829734083624927549_1354 size 116
2013-10-31 18:44:17,048 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8829734083624927549_1354 size 116
2013-10-31 18:44:17,048 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8829734083624927549_1354 size 116
2013-10-31 18:44:17,048 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken from client DFSClient_-1596270109
2013-10-31 18:44:17,049 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:44:17,054 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken
2013-10-31 18:44:17,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:44:17,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51608, bytes: 224, op: HDFS_READ, cliID: DFSClient_-858444681, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1024870396640826331_1350, duration: 273284
2013-10-31 18:44:17,060 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0035 = 309. Number of splits = 6
2013-10-31 18:44:17,060 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,065 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,065 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0035 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:44:17,065 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0035 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:44:17,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4548667154538039926_1345 file build/test/data/dfs/data/data4/current/blk_-4548667154538039926 for deletion
2013-10-31 18:44:17,265 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4548667154538039926_1345 at file build/test/data/dfs/data/data4/current/blk_-4548667154538039926
2013-10-31 18:44:18,463 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-9197354684127990610_1348 to 127.0.0.1:54365 
2013-10-31 18:44:18,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4548667154538039926_1345 file build/test/data/dfs/data/data7/current/blk_-4548667154538039926 for deletion
2013-10-31 18:44:18,465 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4548667154538039926_1345 at file build/test/data/dfs/data/data7/current/blk_-4548667154538039926
2013-10-31 18:44:18,466 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:48980 dest: /127.0.0.1:54365
2013-10-31 18:44:18,466 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-9197354684127990610_1348 to /127.0.0.1:54365
2013-10-31 18:44:18,469 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-9197354684127990610_1348 src: /127.0.0.1:48980 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:44:18,470 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:18,861 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0035_m_000007_0' to tip task_20131031182606197_0035_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:18,869 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:44:18,869 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000007_0 which needs 1 slots
2013-10-31 18:44:18,869 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000007_0 which needs 1 slots
2013-10-31 18:44:18,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken	dst=null	perm=null
2013-10-31 18:44:18,878 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44807, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8829734083624927549_1354, duration: 292061
2013-10-31 18:44:18,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml	dst=null	perm=null
2013-10-31 18:44:18,888 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51612, bytes: 28938, op: HDFS_READ, cliID: DFSClient_1057907758, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 378925
2013-10-31 18:44:18,918 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:18,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar	dst=null	perm=null
2013-10-31 18:44:18,946 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51613, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1057907758, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9197354684127990610_1348, duration: 1184455
2013-10-31 18:44:19,041 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0034_m_-950639163
2013-10-31 18:44:19,048 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4093 with signal TERM. Exit code 0
2013-10-31 18:44:19,048 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_-1380072797
2013-10-31 18:44:19,049 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_-1380072797 spawned.
2013-10-31 18:44:19,050 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000007_0/taskjvm.sh
2013-10-31 18:44:19,581 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-4548667154538039926_1345
2013-10-31 18:44:19,643 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:19,644 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:19,644 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:19,644 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_-950639163 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:44:20,380 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1380072797 given task: attempt_20131031182606197_0035_m_000007_0
2013-10-31 18:44:20,487 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7295626289958709819_1037
2013-10-31 18:44:20,857 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:20,857 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0034_m_000005_0 not found in cache
2013-10-31 18:44:20,858 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383331460858
2013-10-31 18:44:20,858 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:20,859 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383331460859
2013-10-31 18:44:20,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:20,907 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:20,908 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383331460908
2013-10-31 18:44:20,995 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4548667154538039926_1345 file build/test/data/dfs/data/data5/current/blk_-4548667154538039926 for deletion
2013-10-31 18:44:20,995 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4548667154538039926_1345 at file build/test/data/dfs/data/data5/current/blk_-4548667154538039926
2013-10-31 18:44:21,372 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_-1745551915 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:21,383 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4252 with signal TERM. Exit code 0
2013-10-31 18:44:21,559 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:21,559 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:21,559 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:21,559 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_-1745551915 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:44:22,206 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_1100073729 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,216 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_1359958609 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,216 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4254 with signal TERM. Exit code 0
2013-10-31 18:44:22,218 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_921467046 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,227 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4253 with signal TERM. Exit code 0
2013-10-31 18:44:22,228 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4255 with signal TERM. Exit code 0
2013-10-31 18:44:22,254 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_r_-710253377 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,264 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4501 with signal TERM. Exit code 0
2013-10-31 18:44:22,414 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,415 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,415 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:22,415 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_r_-710253377 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:22,453 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,453 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,453 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:22,453 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,453 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,453 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:22,453 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_1359958609 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:22,453 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_921467046 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:22,454 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,454 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,454 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:22,454 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_1100073729 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:23,832 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000007_0 0.0% setup
2013-10-31 18:44:23,835 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000007_0 is done.
2013-10-31 18:44:23,835 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000007_0  was -1
2013-10-31 18:44:23,836 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:24,875 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000007_0' has completed task_20131031182606197_0035_m_000007 successfully.
2013-10-31 18:44:24,878 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000000_0' to tip task_20131031182606197_0035_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:24,879 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000000
2013-10-31 18:44:24,880 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000001_0' to tip task_20131031182606197_0035_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:24,880 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000001
2013-10-31 18:44:24,882 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:44:24,883 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:44:24,884 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000000_0 which needs 1 slots
2013-10-31 18:44:24,884 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000000_0 which needs 1 slots
2013-10-31 18:44:24,884 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000001_0 which needs 1 slots
2013-10-31 18:44:24,885 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0035_m_000001_0 which needs 1 slots
2013-10-31 18:44:24,917 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000002_0' to tip task_20131031182606197_0035_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:44:24,917 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000002
2013-10-31 18:44:24,918 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000003_0' to tip task_20131031182606197_0035_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:44:24,918 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000003
2013-10-31 18:44:24,918 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000004_0' to tip task_20131031182606197_0035_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:44:24,919 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000004
2013-10-31 18:44:24,919 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:44:24,919 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_781049111
2013-10-31 18:44:24,920 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:44:24,919 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000005_0' to tip task_20131031182606197_0035_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:44:24,920 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_781049111 spawned.
2013-10-31 18:44:24,921 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000005
2013-10-31 18:44:24,921 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000002_0 which needs 1 slots
2013-10-31 18:44:24,922 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0035/attempt_20131031182606197_0035_m_000000_0. Attempting to reuse: jvm_20131031182606197_0035_m_-1380072797
2013-10-31 18:44:24,922 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000002_0 which needs 1 slots
2013-10-31 18:44:24,923 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:44:24,923 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000003_0 which needs 1 slots
2013-10-31 18:44:24,924 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:44:24,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0035_m_000003_0 which needs 1 slots
2013-10-31 18:44:24,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000004_0 which needs 1 slots
2013-10-31 18:44:24,925 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000004_0 which needs 1 slots
2013-10-31 18:44:24,926 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000005_0 which needs 1 slots
2013-10-31 18:44:24,926 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000001_0/taskjvm.sh
2013-10-31 18:44:24,926 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0035_m_000005_0 which needs 1 slots
2013-10-31 18:44:24,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken	dst=null	perm=null
2013-10-31 18:44:24,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken	dst=null	perm=null
2013-10-31 18:44:24,930 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51616, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8829734083624927549_1354, duration: 308055
2013-10-31 18:44:24,932 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51617, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8829734083624927549_1354, duration: 546107
2013-10-31 18:44:24,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml	dst=null	perm=null
2013-10-31 18:44:24,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml	dst=null	perm=null
2013-10-31 18:44:24,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44817, bytes: 28938, op: HDFS_READ, cliID: DFSClient_2035508770, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3611869011102150252_1351, duration: 440885
2013-10-31 18:44:24,941 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51621, bytes: 28938, op: HDFS_READ, cliID: DFSClient_881113897, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 389797
2013-10-31 18:44:24,961 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:24,967 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:24,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar	dst=null	perm=null
2013-10-31 18:44:24,978 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44819, bytes: 239915, op: HDFS_READ, cliID: DFSClient_881113897, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9197354684127990610_1348, duration: 598023
2013-10-31 18:44:25,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar	dst=null	perm=null
2013-10-31 18:44:25,147 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48711, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2035508770, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9197354684127990610_1348, duration: 1658351
2013-10-31 18:44:25,213 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_18439869
2013-10-31 18:44:25,214 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_18439869 spawned.
2013-10-31 18:44:25,214 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_-1186787883
2013-10-31 18:44:25,215 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_-1186787883 spawned.
2013-10-31 18:44:25,223 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000005_0/taskjvm.sh
2013-10-31 18:44:25,224 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000004_0/taskjvm.sh
2013-10-31 18:44:25,234 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_-1752732000
2013-10-31 18:44:25,235 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_-1752732000 spawned.
2013-10-31 18:44:25,236 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000002_0/taskjvm.sh
2013-10-31 18:44:25,237 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_1866653766
2013-10-31 18:44:25,238 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_1866653766 spawned.
2013-10-31 18:44:25,239 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000003_0/taskjvm.sh
2013-10-31 18:44:25,391 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1380072797 given task: attempt_20131031182606197_0035_m_000000_0
2013-10-31 18:44:25,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:25,509 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44822, bytes: 2103, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3425796593221907686_1349, duration: 357838
2013-10-31 18:44:25,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000	dst=null	perm=null
2013-10-31 18:44:25,548 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48714, bytes: 294, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5157468367762981491_1346, duration: 256267
2013-10-31 18:44:26,742 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_781049111 given task: attempt_20131031182606197_0035_m_000001_0
2013-10-31 18:44:27,242 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_1866653766 given task: attempt_20131031182606197_0035_m_000003_0
2013-10-31 18:44:27,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:27,249 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51633, bytes: 2103, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3425796593221907686_1349, duration: 165309
2013-10-31 18:44:27,256 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1752732000 given task: attempt_20131031182606197_0035_m_000002_0
2013-10-31 18:44:27,265 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1186787883 given task: attempt_20131031182606197_0035_m_000004_0
2013-10-31 18:44:27,271 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_18439869 given task: attempt_20131031182606197_0035_m_000005_0
2013-10-31 18:44:27,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:27,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44831, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 174539
2013-10-31 18:44:27,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:27,762 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51639, bytes: 1071, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3425796593221907686_1349, duration: 170645
2013-10-31 18:44:27,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:27,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:27,772 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44837, bytes: 555, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000005_0, offset: 1536, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3425796593221907686_1349, duration: 141061
2013-10-31 18:44:27,773 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49012, bytes: 1587, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3425796593221907686_1349, duration: 139219
2013-10-31 18:44:27,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:27,801 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44839, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 109216
2013-10-31 18:44:27,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split	dst=null	perm=null
2013-10-31 18:44:27,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:27,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:27,811 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44840, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000005_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 111796
2013-10-31 18:44:27,814 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49015, bytes: 1071, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000004_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3425796593221907686_1349, duration: 726269
2013-10-31 18:44:27,814 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44842, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 1103677
2013-10-31 18:44:27,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:44:27,852 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49017, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 113985
2013-10-31 18:44:28,471 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000:0+290
2013-10-31 18:44:28,474 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000000_0 is done.
2013-10-31 18:44:28,474 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000000_0  was 176
2013-10-31 18:44:28,474 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:44:29,884 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0035_m_000007_0
2013-10-31 18:44:29,884 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0035_m_000007_0
2013-10-31 18:44:29,884 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0035_m_000007_0 not found in cache
2013-10-31 18:44:30,178 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+4
2013-10-31 18:44:30,180 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000001_0 is done.
2013-10-31 18:44:30,180 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000001_0  was 23
2013-10-31 18:44:30,181 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:30,681 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:8+4
2013-10-31 18:44:30,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000003_0 is done.
2013-10-31 18:44:30,684 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000003_0  was 23
2013-10-31 18:44:30,684 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:44:30,701 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000005_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:16+3
2013-10-31 18:44:30,702 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:4+4
2013-10-31 18:44:30,703 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000005_0 is done.
2013-10-31 18:44:30,703 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000005_0  was 23
2013-10-31 18:44:30,703 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:44:30,704 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000002_0 is done.
2013-10-31 18:44:30,704 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000002_0  was 23
2013-10-31 18:44:30,704 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:30,739 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000004_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:12+4
2013-10-31 18:44:30,741 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000004_0 is done.
2013-10-31 18:44:30,741 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000004_0  was 23
2013-10-31 18:44:30,741 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:30,887 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000000_0' has completed task_20131031182606197_0035_m_000000 successfully.
2013-10-31 18:44:31,529 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000001_0' has completed task_20131031182606197_0035_m_000001 successfully.
2013-10-31 18:44:31,531 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0035_r_000000_0' to tip task_20131031182606197_0035_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:31,532 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000004_0' has completed task_20131031182606197_0035_m_000004 successfully.
2013-10-31 18:44:31,534 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:44:31,534 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_r_000000_0 which needs 1 slots
2013-10-31 18:44:31,535 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000005_0' has completed task_20131031182606197_0035_m_000005 successfully.
2013-10-31 18:44:31,535 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_r_000000_0 which needs 1 slots
2013-10-31 18:44:31,539 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000002_0' has completed task_20131031182606197_0035_m_000002 successfully.
2013-10-31 18:44:31,540 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000003_0' has completed task_20131031182606197_0035_m_000003 successfully.
2013-10-31 18:44:31,572 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_r_1908169258
2013-10-31 18:44:31,574 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_r_1908169258 spawned.
2013-10-31 18:44:31,577 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_r_000000_0/taskjvm.sh
2013-10-31 18:44:32,400 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_r_1908169258 given task: attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:38,079 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41033, bytes: 176, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000000_0, duration: 7696417
2013-10-31 18:44:38,093 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41033, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000001_0, duration: 7992580
2013-10-31 18:44:38,109 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45731, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000004_0, duration: 12434451
2013-10-31 18:44:38,124 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45731, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000005_0, duration: 11240125
2013-10-31 18:44:38,141 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50690, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000002_0, duration: 11673322
2013-10-31 18:44:38,156 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50690, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000003_0, duration: 11434477
2013-10-31 18:44:38,865 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:38,938 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:38,992 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:39,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:39,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:39,236 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000. blk_-1378031811604442201_1355
2013-10-31 18:44:39,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1378031811604442201_1355 src: /127.0.0.1:48743 dest: /127.0.0.1:37740
2013-10-31 18:44:39,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1378031811604442201_1355 src: /127.0.0.1:51656 dest: /127.0.0.1:34578
2013-10-31 18:44:39,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1378031811604442201_1355 src: /127.0.0.1:44854 dest: /127.0.0.1:59471
2013-10-31 18:44:39,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44854, dest: /127.0.0.1:59471, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0035_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1378031811604442201_1355, duration: 2025828
2013-10-31 18:44:39,286 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1378031811604442201_1355 terminating
2013-10-31 18:44:39,286 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1378031811604442201_1355 size 60
2013-10-31 18:44:39,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51656, dest: /127.0.0.1:34578, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0035_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1378031811604442201_1355, duration: 2600227
2013-10-31 18:44:39,287 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1378031811604442201_1355 terminating
2013-10-31 18:44:39,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48743, dest: /127.0.0.1:37740, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0035_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1378031811604442201_1355, duration: 3176931
2013-10-31 18:44:39,287 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1378031811604442201_1355 terminating
2013-10-31 18:44:39,289 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1378031811604442201_1355 size 60
2013-10-31 18:44:39,290 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:39,290 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:39,290 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1378031811604442201_1355 size 60
2013-10-31 18:44:39,325 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0035_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:44:39,326 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:40,544 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   6 OK for attempt_20131031182606197_0035_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:44:40,545 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:41,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0	dst=null	perm=null
2013-10-31 18:44:41,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:41,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:41,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0	dst=null	perm=null
2013-10-31 18:44:41,915 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:41,917 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:41,918 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_r_000000_0 is done.
2013-10-31 18:44:41,918 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_r_000000_0  was -1
2013-10-31 18:44:41,918 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:43,548 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_r_000000_0' has completed task_20131031182606197_0035_r_000000 successfully.
2013-10-31 18:44:43,551 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0035_m_000006_0' to tip task_20131031182606197_0035_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:43,554 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:44:43,554 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000006_0 which needs 1 slots
2013-10-31 18:44:43,554 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000006_0 which needs 1 slots
2013-10-31 18:44:43,583 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0035/attempt_20131031182606197_0035_m_000006_0. Attempting to reuse: jvm_20131031182606197_0035_m_-1380072797
2013-10-31 18:44:44,019 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1380072797 given task: attempt_20131031182606197_0035_m_000006_0
2013-10-31 18:44:44,137 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000006_0 0.0% 
2013-10-31 18:44:44,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary	dst=null	perm=null
2013-10-31 18:44:44,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:44,293 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_SUCCESS from client DFSClient_attempt_20131031182606197_0035_m_000006_0
2013-10-31 18:44:44,293 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0035_m_000006_0
2013-10-31 18:44:44,299 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,300 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,300 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,300 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:44,300 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:44,301 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,301 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,301 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,301 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1024870396640826331 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,301 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1024870396640826331 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,302 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1024870396640826331 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,302 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3611869011102150252 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,302 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3611869011102150252 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,302 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3611869011102150252 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035	dst=null	perm=null
2013-10-31 18:44:46,585 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-9197354684127990610_1348 blk_1024870396640826331_1350 blk_3611869011102150252_1351 blk_-3425796593221907686_1349
2013-10-31 18:44:46,586 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-9197354684127990610_1348 blk_-3425796593221907686_1349
2013-10-31 18:44:47,111 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000006_0 0.0% cleanup
2013-10-31 18:44:47,112 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000006_0 is done.
2013-10-31 18:44:47,112 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000006_0  was -1
2013-10-31 18:44:47,113 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:47,275 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data3/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:47,275 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data3/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:47,275 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data3/current/blk_-9197354684127990610
2013-10-31 18:44:47,276 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data3/current/blk_-3425796593221907686
2013-10-31 18:44:48,004 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data6/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:48,004 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data5/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:48,004 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data6/current/blk_-9197354684127990610
2013-10-31 18:44:48,004 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1024870396640826331_1350 file build/test/data/dfs/data/data6/current/blk_1024870396640826331 for deletion
2013-10-31 18:44:48,004 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data5/current/blk_-3425796593221907686
2013-10-31 18:44:48,005 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1024870396640826331_1350 at file build/test/data/dfs/data/data6/current/blk_1024870396640826331
2013-10-31 18:44:48,005 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3611869011102150252_1351 file build/test/data/dfs/data/data5/current/blk_3611869011102150252 for deletion
2013-10-31 18:44:48,006 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3611869011102150252_1351 at file build/test/data/dfs/data/data5/current/blk_3611869011102150252
2013-10-31 18:44:48,554 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:48,554 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:49,561 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000006_0' has completed task_20131031182606197_0035_m_000006 successfully.
2013-10-31 18:44:49,586 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-9197354684127990610_1348 blk_1024870396640826331_1350 blk_3611869011102150252_1351 blk_-3425796593221907686_1349
2013-10-31 18:44:49,587 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-9197354684127990610_1348 blk_1024870396640826331_1350 blk_3611869011102150252_1351 blk_-3425796593221907686_1349
2013-10-31 18:44:49,591 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0035 has completed successfully.
2013-10-31 18:44:49,591 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0035,submitTime=1383245056926,launchTime=1383245057065,firstMapTaskLaunchTime=1383245064878,firstReduceTaskLaunchTime=1383245071531,firstJobSetupTaskLaunchTime=1383245058861,firstJobCleanupTaskLaunchTime=1383245083551,finishTime=1383245089590,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[CE7497985D0148D183840F8CF65154C9/E765166B4CC1473E97204773FB6BA846] lower+upper+offset/(1/2) .../samemergethreechaingroup
2013-10-31 18:44:49,661 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E. blk_7501251780735780255_1356
2013-10-31 18:44:49,665 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7501251780735780255_1356 src: /127.0.0.1:51661 dest: /127.0.0.1:34578
2013-10-31 18:44:49,668 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7501251780735780255_1356 src: /127.0.0.1:49033 dest: /127.0.0.1:54365
2013-10-31 18:44:49,670 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7501251780735780255_1356 src: /127.0.0.1:48751 dest: /127.0.0.1:37740
2013-10-31 18:44:49,679 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48751, dest: /127.0.0.1:37740, bytes: 35820, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7501251780735780255_1356, duration: 6872444
2013-10-31 18:44:49,680 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7501251780735780255_1356 terminating
2013-10-31 18:44:49,680 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49033, dest: /127.0.0.1:54365, bytes: 35820, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7501251780735780255_1356, duration: 7700416
2013-10-31 18:44:49,681 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7501251780735780255_1356 terminating
2013-10-31 18:44:49,681 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51661, dest: /127.0.0.1:34578, bytes: 35820, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7501251780735780255_1356, duration: 8729671
2013-10-31 18:44:49,682 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7501251780735780255_1356 terminating
2013-10-31 18:44:49,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7501251780735780255_1356 size 35820
2013-10-31 18:44:49,693 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E from client DFSClient_-858444681
2013-10-31 18:44:49,693 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E is closed by DFSClient_-858444681
2013-10-31 18:44:49,694 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7501251780735780255_1356 size 35820
2013-10-31 18:44:49,694 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7501251780735780255_1356 size 35820
2013-10-31 18:44:49,699 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:49,700 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000000_0'
2013-10-31 18:44:49,701 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000001_0'
2013-10-31 18:44:49,701 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000006_0'
2013-10-31 18:44:49,702 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000007_0'
2013-10-31 18:44:49,703 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8829734083624927549 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,703 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_r_000000_0'
2013-10-31 18:44:49,703 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8829734083624927549 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:49,704 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8829734083624927549 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:49,704 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000002_0'
2013-10-31 18:44:49,704 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000003_0'
2013-10-31 18:44:49,705 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000004_0'
2013-10-31 18:44:49,705 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000005_0'
2013-10-31 18:44:49,706 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0035_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:49,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035	dst=null	perm=null
2013-10-31 18:44:49,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5199617541030467941 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:49,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5199617541030467941 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5199617541030467941 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:49,712 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7916561388913392372 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7916561388913392372 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:49,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7916561388913392372 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:49,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5157468367762981491 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:49,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5157468367762981491 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:49,713 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5157468367762981491 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1	dst=null	perm=null
2013-10-31 18:44:49,719 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary
2013-10-31 18:44:49,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup	dst=null	perm=null
2013-10-31 18:44:49,739 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:49,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000	dst=null	perm=null
2013-10-31 18:44:49,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000	dst=null	perm=null
2013-10-31 18:44:49,744 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48753, bytes: 64, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1378031811604442201_1355, duration: 291708
2013-10-31 18:44:49,745 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/samemergethreechaingroup
2013-10-31 18:44:49,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup	dst=null	perm=null
2013-10-31 18:44:49,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000	dst=null	perm=null
2013-10-31 18:44:49,753 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48754, bytes: 64, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1378031811604442201_1355, duration: 271293
2013-10-31 18:44:49,773 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:44:49,774 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:44:49,783 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:44:49,784 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:44:49,784 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace"]
2013-10-31 18:44:49,784 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:44:49,784 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:44:49,785 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:44:49,786 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...ldedpipesplatform/replace
2013-10-31 18:44:49,789 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:44:49,789 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:44:49,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:49,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:44:49,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,811 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar. blk_1418774395172716651_1357
2013-10-31 18:44:49,812 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:51667 dest: /127.0.0.1:34578
2013-10-31 18:44:49,813 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:49039 dest: /127.0.0.1:54365
2013-10-31 18:44:49,817 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:48757 dest: /127.0.0.1:37740
2013-10-31 18:44:49,825 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48757, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1418774395172716651_1357, duration: 6139941
2013-10-31 18:44:49,826 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1418774395172716651_1357 terminating
2013-10-31 18:44:49,826 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49039, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1418774395172716651_1357, duration: 4621727
2013-10-31 18:44:49,827 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:49,827 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1418774395172716651_1357 terminating
2013-10-31 18:44:49,827 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51667, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1418774395172716651_1357, duration: 5694515
2013-10-31 18:44:49,828 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1418774395172716651_1357 terminating
2013-10-31 18:44:49,828 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:49,832 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar from client DFSClient_-1596270109
2013-10-31 18:44:49,833 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:44:49,833 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:49,840 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar. New replication is 10
2013-10-31 18:44:49,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=null
2013-10-31 18:44:49,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,856 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:44:49,860 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:49,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:44:49,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,883 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split. New replication is 10
2013-10-31 18:44:49,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=null
2013-10-31 18:44:49,890 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split. blk_8337267597493363863_1358
2013-10-31 18:44:49,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:51670 dest: /127.0.0.1:34578
2013-10-31 18:44:49,893 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:44868 dest: /127.0.0.1:59471
2013-10-31 18:44:49,895 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:48760 dest: /127.0.0.1:37740
2013-10-31 18:44:49,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:49044 dest: /127.0.0.1:54365
2013-10-31 18:44:49,900 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49044, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8337267597493363863_1358, duration: 108007
2013-10-31 18:44:49,900 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,901 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48760, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8337267597493363863_1358, duration: 908556
2013-10-31 18:44:49,901 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,901 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44868, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8337267597493363863_1358, duration: 1919708
2013-10-31 18:44:49,902 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,902 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51670, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8337267597493363863_1358, duration: 2686931
2013-10-31 18:44:49,903 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,903 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,906 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split from client DFSClient_-1596270109
2013-10-31 18:44:49,907 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split is closed by DFSClient_-1596270109
2013-10-31 18:44:49,907 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,927 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo. blk_-1705170389491270417_1359
2013-10-31 18:44:49,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1705170389491270417_1359 src: /127.0.0.1:48762 dest: /127.0.0.1:37740
2013-10-31 18:44:49,930 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1705170389491270417_1359 src: /127.0.0.1:44872 dest: /127.0.0.1:59471
2013-10-31 18:44:49,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1705170389491270417_1359 src: /127.0.0.1:49047 dest: /127.0.0.1:54365
2013-10-31 18:44:49,935 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49047, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1705170389491270417_1359, duration: 88525
2013-10-31 18:44:49,935 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1705170389491270417_1359 terminating
2013-10-31 18:44:49,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44872, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1705170389491270417_1359, duration: 1017110
2013-10-31 18:44:49,936 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1705170389491270417_1359 terminating
2013-10-31 18:44:49,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48762, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1705170389491270417_1359, duration: 2067128
2013-10-31 18:44:49,937 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1705170389491270417_1359 terminating
2013-10-31 18:44:49,940 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1705170389491270417_1359 size 156
2013-10-31 18:44:49,941 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:44:49,941 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:44:49,941 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1705170389491270417_1359 size 156
2013-10-31 18:44:49,942 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1705170389491270417_1359 size 156
2013-10-31 18:44:49,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,458 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml. blk_3392666785987107417_1360
2013-10-31 18:44:50,460 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3392666785987107417_1360 src: /127.0.0.1:49048 dest: /127.0.0.1:54365
2013-10-31 18:44:50,462 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3392666785987107417_1360 src: /127.0.0.1:51678 dest: /127.0.0.1:34578
2013-10-31 18:44:50,463 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3392666785987107417_1360 src: /127.0.0.1:48767 dest: /127.0.0.1:37740
2013-10-31 18:44:50,467 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48767, dest: /127.0.0.1:37740, bytes: 27592, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 751296
2013-10-31 18:44:50,468 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3392666785987107417_1360 terminating
2013-10-31 18:44:50,468 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51678, dest: /127.0.0.1:34578, bytes: 27592, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3392666785987107417_1360, duration: 1531729
2013-10-31 18:44:50,469 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3392666785987107417_1360 terminating
2013-10-31 18:44:50,469 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49048, dest: /127.0.0.1:54365, bytes: 27592, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3392666785987107417_1360, duration: 2508767
2013-10-31 18:44:50,470 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3392666785987107417_1360 terminating
2013-10-31 18:44:50,470 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3392666785987107417_1360 size 27592
2013-10-31 18:44:50,473 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml from client DFSClient_-1596270109
2013-10-31 18:44:50,473 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:44:50,473 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3392666785987107417_1360 size 27592
2013-10-31 18:44:50,474 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3392666785987107417_1360 size 27592
2013-10-31 18:44:50,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=null
2013-10-31 18:44:50,488 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48769, bytes: 27808, op: HDFS_READ, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 401361
2013-10-31 18:44:50,506 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0036: nMaps=4 nReduces=0 max=-1
2013-10-31 18:44:50,507 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0036 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:44:50,507 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0036
2013-10-31 18:44:50,507 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0036	RESULT=SUCCESS
2013-10-31 18:44:50,507 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0036
2013-10-31 18:44:50,508 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0036
2013-10-31 18:44:50,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,538 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml. blk_-517063638890165572_1362
2013-10-31 18:44:50,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-517063638890165572_1362 src: /127.0.0.1:49053 dest: /127.0.0.1:54365
2013-10-31 18:44:50,542 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-517063638890165572_1362 src: /127.0.0.1:48771 dest: /127.0.0.1:37740
2013-10-31 18:44:50,543 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-517063638890165572_1362 src: /127.0.0.1:44881 dest: /127.0.0.1:59471
2013-10-31 18:44:50,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44881, dest: /127.0.0.1:59471, bytes: 27657, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-517063638890165572_1362, duration: 696636
2013-10-31 18:44:50,550 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-517063638890165572_1362 terminating
2013-10-31 18:44:50,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48771, dest: /127.0.0.1:37740, bytes: 27657, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-517063638890165572_1362, duration: 1952919
2013-10-31 18:44:50,551 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-517063638890165572_1362 terminating
2013-10-31 18:44:50,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49053, dest: /127.0.0.1:54365, bytes: 27657, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-517063638890165572_1362, duration: 2570526
2013-10-31 18:44:50,552 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-517063638890165572_1362 terminating
2013-10-31 18:44:50,555 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-517063638890165572_1362 size 27657
2013-10-31 18:44:50,556 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-517063638890165572_1362 size 27657
2013-10-31 18:44:50,556 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-517063638890165572_1362 size 27657
2013-10-31 18:44:50,955 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml from client DFSClient_-471295458
2013-10-31 18:44:50,956 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml is closed by DFSClient_-471295458
2013-10-31 18:44:50,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,969 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken. blk_-2610187700968762386_1363
2013-10-31 18:44:50,970 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2610187700968762386_1363 src: /127.0.0.1:49056 dest: /127.0.0.1:54365
2013-10-31 18:44:50,972 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2610187700968762386_1363 src: /127.0.0.1:44883 dest: /127.0.0.1:59471
2013-10-31 18:44:50,973 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2610187700968762386_1363 src: /127.0.0.1:51687 dest: /127.0.0.1:34578
2013-10-31 18:44:50,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51687, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 1034584
2013-10-31 18:44:50,975 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2610187700968762386_1363 terminating
2013-10-31 18:44:50,975 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44883, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2610187700968762386_1363, duration: 1185097
2013-10-31 18:44:50,975 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2610187700968762386_1363 terminating
2013-10-31 18:44:50,976 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2610187700968762386_1363 size 116
2013-10-31 18:44:50,976 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49056, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2610187700968762386_1363, duration: 1735734
2013-10-31 18:44:50,977 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2610187700968762386_1363 terminating
2013-10-31 18:44:50,979 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2610187700968762386_1363 size 116
2013-10-31 18:44:50,979 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken from client DFSClient_-1596270109
2013-10-31 18:44:50,980 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:44:50,981 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2610187700968762386_1363 size 116
2013-10-31 18:44:50,983 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken
2013-10-31 18:44:50,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:44:50,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48776, bytes: 160, op: HDFS_READ, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1705170389491270417_1359, duration: 127340
2013-10-31 18:44:50,987 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0036 = 1449. Number of splits = 4
2013-10-31 18:44:50,987 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0036 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:44:50,991 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0036 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:44:51,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data2/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:51,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data1/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:51,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1024870396640826331_1350 file build/test/data/dfs/data/data2/current/blk_1024870396640826331 for deletion
2013-10-31 18:44:51,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data1/current/blk_-3425796593221907686
2013-10-31 18:44:51,403 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3611869011102150252_1351 file build/test/data/dfs/data/data1/current/blk_3611869011102150252 for deletion
2013-10-31 18:44:51,402 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data2/current/blk_-9197354684127990610
2013-10-31 18:44:51,403 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3611869011102150252_1351 at file build/test/data/dfs/data/data1/current/blk_3611869011102150252
2013-10-31 18:44:51,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1024870396640826331_1350 at file build/test/data/dfs/data/data2/current/blk_1024870396640826331
2013-10-31 18:44:51,475 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data8/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:51,475 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data7/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:51,475 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data8/current/blk_-9197354684127990610
2013-10-31 18:44:51,475 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data7/current/blk_-3425796593221907686
2013-10-31 18:44:51,475 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1024870396640826331_1350 file build/test/data/dfs/data/data8/current/blk_1024870396640826331 for deletion
2013-10-31 18:44:51,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3611869011102150252_1351 file build/test/data/dfs/data/data7/current/blk_3611869011102150252 for deletion
2013-10-31 18:44:51,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1024870396640826331_1350 at file build/test/data/dfs/data/data8/current/blk_1024870396640826331
2013-10-31 18:44:51,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3611869011102150252_1351 at file build/test/data/dfs/data/data7/current/blk_3611869011102150252
2013-10-31 18:44:51,905 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0036_m_000005_0' to tip task_20131031182606197_0036_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:44:51,913 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:44:51,914 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000005_0 which needs 1 slots
2013-10-31 18:44:51,914 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:51,914 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000005_0 which needs 1 slots
2013-10-31 18:44:51,914 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0035 being deleted.
2013-10-31 18:44:51,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken	dst=null	perm=null
2013-10-31 18:44:51,923 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51689, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 359846
2013-10-31 18:44:51,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=null
2013-10-31 18:44:51,933 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48779, bytes: 27808, op: HDFS_READ, cliID: DFSClient_-1363826906, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 387858
2013-10-31 18:44:51,957 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:51,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=null
2013-10-31 18:44:51,972 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51692, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1363826906, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1418774395172716651_1357, duration: 836609
2013-10-31 18:44:52,068 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_1321699708
2013-10-31 18:44:52,069 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_1321699708 spawned.
2013-10-31 18:44:52,071 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000005_0/taskjvm.sh
2013-10-31 18:44:52,587 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_1418774395172716651_1357 to datanode(s) 127.0.0.1:59471
2013-10-31 18:44:52,587 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-8829734083624927549_1354 blk_7916561388913392372_1344 blk_5157468367762981491_1346
2013-10-31 18:44:52,587 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-8829734083624927549_1354 blk_7916561388913392372_1344 blk_5157468367762981491_1346 blk_-5199617541030467941_1347
2013-10-31 18:44:53,246 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_1321699708 given task: attempt_20131031182606197_0036_m_000005_0
2013-10-31 18:44:53,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:54,403 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_1418774395172716651_1357 to 127.0.0.1:59471 
2013-10-31 18:44:54,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8829734083624927549_1354 file build/test/data/dfs/data/data2/current/blk_-8829734083624927549 for deletion
2013-10-31 18:44:54,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5157468367762981491_1346 file build/test/data/dfs/data/data1/current/blk_5157468367762981491 for deletion
2013-10-31 18:44:54,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8829734083624927549_1354 at file build/test/data/dfs/data/data2/current/blk_-8829734083624927549
2013-10-31 18:44:54,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5157468367762981491_1346 at file build/test/data/dfs/data/data1/current/blk_5157468367762981491
2013-10-31 18:44:54,404 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7916561388913392372_1344 file build/test/data/dfs/data/data2/current/blk_7916561388913392372 for deletion
2013-10-31 18:44:54,405 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7916561388913392372_1344 at file build/test/data/dfs/data/data2/current/blk_7916561388913392372
2013-10-31 18:44:54,405 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:44892 dest: /127.0.0.1:59471
2013-10-31 18:44:54,405 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_1418774395172716651_1357 to /127.0.0.1:59471
2013-10-31 18:44:54,409 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1418774395172716651_1357 src: /127.0.0.1:44892 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:44:54,409 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:54,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8829734083624927549_1354 file build/test/data/dfs/data/data7/current/blk_-8829734083624927549 for deletion
2013-10-31 18:44:54,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5199617541030467941_1347 file build/test/data/dfs/data/data7/current/blk_-5199617541030467941 for deletion
2013-10-31 18:44:54,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8829734083624927549_1354 at file build/test/data/dfs/data/data7/current/blk_-8829734083624927549
2013-10-31 18:44:54,476 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5157468367762981491_1346 file build/test/data/dfs/data/data8/current/blk_5157468367762981491 for deletion
2013-10-31 18:44:54,477 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5199617541030467941_1347 at file build/test/data/dfs/data/data7/current/blk_-5199617541030467941
2013-10-31 18:44:54,477 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7916561388913392372_1344 file build/test/data/dfs/data/data8/current/blk_7916561388913392372 for deletion
2013-10-31 18:44:54,477 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5157468367762981491_1346 at file build/test/data/dfs/data/data8/current/blk_5157468367762981491
2013-10-31 18:44:54,477 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7916561388913392372_1344 at file build/test/data/dfs/data/data8/current/blk_7916561388913392372
2013-10-31 18:44:54,704 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:54,704 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0035_m_000006_0 not found in cache
2013-10-31 18:44:54,705 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:54,705 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383331494705
2013-10-31 18:44:54,706 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:54,706 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383331494706
2013-10-31 18:44:54,707 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383331494706
2013-10-31 18:44:54,750 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_781049111 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:54,758 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4905 with signal TERM. Exit code 0
2013-10-31 18:44:55,045 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,046 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,046 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:55,047 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_781049111 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,152 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_-1380072797 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,161 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4705 with signal TERM. Exit code 0
2013-10-31 18:44:55,264 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_1866653766 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,270 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_18439869 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,272 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4945 with signal TERM. Exit code 0
2013-10-31 18:44:55,273 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_-1752732000 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,276 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4943 with signal TERM. Exit code 0
2013-10-31 18:44:55,287 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4942 with signal TERM. Exit code 0
2013-10-31 18:44:55,310 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_-1186787883 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,314 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4944 with signal TERM. Exit code 0
2013-10-31 18:44:55,369 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,369 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,369 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:55,370 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_-1380072797 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:44:55,495 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,495 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,495 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:55,496 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_1866653766 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,496 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,497 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,497 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:55,497 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_-1752732000 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,526 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,526 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,526 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:55,526 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_-1186787883 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,533 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,533 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,533 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:55,534 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_18439869 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,588 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_7916561388913392372_1344 blk_-5199617541030467941_1347
2013-10-31 18:44:55,588 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-8829734083624927549_1354 blk_5157468367762981491_1346 blk_-5199617541030467941_1347
2013-10-31 18:44:55,959 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_r_1908169258 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,967 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5216 with signal TERM. Exit code 0
2013-10-31 18:44:56,000 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:44:56,005 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,011 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,032 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:44:56,135 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:56,135 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:56,135 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:44:56,136 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_r_1908169258 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:56,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5199617541030467941_1347 file build/test/data/dfs/data/data4/current/blk_-5199617541030467941 for deletion
2013-10-31 18:44:56,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7916561388913392372_1344 file build/test/data/dfs/data/data3/current/blk_7916561388913392372 for deletion
2013-10-31 18:44:56,278 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5199617541030467941_1347 at file build/test/data/dfs/data/data4/current/blk_-5199617541030467941
2013-10-31 18:44:56,279 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7916561388913392372_1344 at file build/test/data/dfs/data/data3/current/blk_7916561388913392372
2013-10-31 18:44:56,679 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000005_0 0.0% setup
2013-10-31 18:44:56,682 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000005_0 is done.
2013-10-31 18:44:56,682 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000005_0  was -1
2013-10-31 18:44:56,682 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:57,007 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8829734083624927549_1354 file build/test/data/dfs/data/data5/current/blk_-8829734083624927549 for deletion
2013-10-31 18:44:57,007 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5199617541030467941_1347 file build/test/data/dfs/data/data5/current/blk_-5199617541030467941 for deletion
2013-10-31 18:44:57,007 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8829734083624927549_1354 at file build/test/data/dfs/data/data5/current/blk_-8829734083624927549
2013-10-31 18:44:57,007 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5157468367762981491_1346 file build/test/data/dfs/data/data6/current/blk_5157468367762981491 for deletion
2013-10-31 18:44:57,008 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5199617541030467941_1347 at file build/test/data/dfs/data/data5/current/blk_-5199617541030467941
2013-10-31 18:44:57,008 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5157468367762981491_1346 at file build/test/data/dfs/data/data6/current/blk_5157468367762981491
2013-10-31 18:44:57,917 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000005_0' has completed task_20131031182606197_0036_m_000005 successfully.
2013-10-31 18:44:57,920 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000000_0' to tip task_20131031182606197_0036_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:44:57,921 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000000
2013-10-31 18:44:57,923 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:44:57,923 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000000_0 which needs 1 slots
2013-10-31 18:44:57,924 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000000_0 which needs 1 slots
2013-10-31 18:44:57,959 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-1876538490
2013-10-31 18:44:57,960 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-1876538490 spawned.
2013-10-31 18:44:57,962 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000000_0/taskjvm.sh
2013-10-31 18:44:58,713 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000001_0' to tip task_20131031182606197_0036_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:58,714 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000001
2013-10-31 18:44:58,715 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:44:58,715 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000001_0 which needs 1 slots
2013-10-31 18:44:58,715 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000002_0' to tip task_20131031182606197_0036_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:44:58,715 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000001_0 which needs 1 slots
2013-10-31 18:44:58,715 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000002
2013-10-31 18:44:58,717 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:44:58,717 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000003_0' to tip task_20131031182606197_0036_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:44:58,717 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000002_0 which needs 1 slots
2013-10-31 18:44:58,717 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000002_0 which needs 1 slots
2013-10-31 18:44:58,717 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000003
2013-10-31 18:44:58,718 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:44:58,718 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000003_0 which needs 1 slots
2013-10-31 18:44:58,718 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000003_0 which needs 1 slots
2013-10-31 18:44:58,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken	dst=null	perm=null
2013-10-31 18:44:58,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken	dst=null	perm=null
2013-10-31 18:44:58,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken	dst=null	perm=null
2013-10-31 18:44:58,721 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51698, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 181338
2013-10-31 18:44:58,723 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51700, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 161286
2013-10-31 18:44:58,723 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44896, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2610187700968762386_1363, duration: 162242
2013-10-31 18:44:58,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=null
2013-10-31 18:44:58,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=null
2013-10-31 18:44:58,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51704, bytes: 27808, op: HDFS_READ, cliID: DFSClient_1558358188, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3392666785987107417_1360, duration: 188738
2013-10-31 18:44:58,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml	dst=null	perm=null
2013-10-31 18:44:58,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48793, bytes: 27808, op: HDFS_READ, cliID: DFSClient_1412464442, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 219626
2013-10-31 18:44:58,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51706, bytes: 27808, op: HDFS_READ, cliID: DFSClient_1100069603, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3392666785987107417_1360, duration: 205390
2013-10-31 18:44:58,740 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:58,741 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:58,743 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:58,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=null
2013-10-31 18:44:58,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=null
2013-10-31 18:44:58,755 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44904, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1558358188, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1418774395172716651_1357, duration: 757141
2013-10-31 18:44:58,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar	dst=null	perm=null
2013-10-31 18:44:58,756 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49079, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1412464442, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1418774395172716651_1357, duration: 708495
2013-10-31 18:44:58,758 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48797, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1100069603, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1418774395172716651_1357, duration: 704114
2013-10-31 18:44:58,785 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-1876538490 given task: attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:44:58,815 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-1109083427
2013-10-31 18:44:58,816 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-1109083427 spawned.
2013-10-31 18:44:58,817 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-2092873717
2013-10-31 18:44:58,817 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-2092873717 spawned.
2013-10-31 18:44:58,824 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000001_0/taskjvm.sh
2013-10-31 18:44:58,825 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-1832274535
2013-10-31 18:44:58,826 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-1832274535 spawned.
2013-10-31 18:44:58,827 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000003_0/taskjvm.sh
2013-10-31 18:44:58,828 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000002_0/taskjvm.sh
2013-10-31 18:44:59,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=null
2013-10-31 18:44:59,878 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48799, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8337267597493363863_1358, duration: 167957
2013-10-31 18:44:59,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:44:59,918 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48800, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 112863
2013-10-31 18:44:59,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:59,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:00,106 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000. blk_60333104980117936_1364
2013-10-31 18:45:00,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_60333104980117936_1364 src: /127.0.0.1:51713 dest: /127.0.0.1:34578
2013-10-31 18:45:00,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_60333104980117936_1364 src: /127.0.0.1:48802 dest: /127.0.0.1:37740
2013-10-31 18:45:00,133 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_60333104980117936_1364 src: /127.0.0.1:49086 dest: /127.0.0.1:54365
2013-10-31 18:45:00,135 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49086, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_60333104980117936_1364, duration: 1252578
2013-10-31 18:45:00,135 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_60333104980117936_1364 terminating
2013-10-31 18:45:00,136 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48802, dest: /127.0.0.1:37740, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_60333104980117936_1364, duration: 1680798
2013-10-31 18:45:00,136 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_60333104980117936_1364 terminating
2013-10-31 18:45:00,136 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_60333104980117936_1364 size 40
2013-10-31 18:45:00,136 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51713, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_60333104980117936_1364, duration: 2141599
2013-10-31 18:45:00,136 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_60333104980117936_1364 terminating
2013-10-31 18:45:00,137 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:45:00,138 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:45:00,139 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_60333104980117936_1364 size 40
2013-10-31 18:45:00,140 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_60333104980117936_1364 size 40
2013-10-31 18:45:00,203 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:00,203 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000000_0 0.0% 
2013-10-31 18:45:00,399 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-1109083427 given task: attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:00,448 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-2092873717 given task: attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:00,452 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-1832274535 given task: attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:00,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=null
2013-10-31 18:45:00,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44919, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8337267597493363863_1358, duration: 167062
2013-10-31 18:45:00,926 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:45:00,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=null
2013-10-31 18:45:00,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44920, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8337267597493363863_1358, duration: 117516
2013-10-31 18:45:00,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:00,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split	dst=null	perm=null
2013-10-31 18:45:00,965 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49095, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8337267597493363863_1358, duration: 157307
2013-10-31 18:45:00,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:00,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:00,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:00,987 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49096, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 151627
2013-10-31 18:45:00,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:01,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:01,005 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48814, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 163284
2013-10-31 18:45:01,165 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49098, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 376977
2013-10-31 18:45:01,170 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001. blk_-2807215931494117822_1366
2013-10-31 18:45:01,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2807215931494117822_1366 src: /127.0.0.1:51728 dest: /127.0.0.1:34578
2013-10-31 18:45:01,202 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2807215931494117822_1366 src: /127.0.0.1:49100 dest: /127.0.0.1:54365
2013-10-31 18:45:01,204 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2807215931494117822_1366 src: /127.0.0.1:48818 dest: /127.0.0.1:37740
2013-10-31 18:45:01,207 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48818, dest: /127.0.0.1:37740, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2807215931494117822_1366, duration: 1676309
2013-10-31 18:45:01,208 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2807215931494117822_1366 terminating
2013-10-31 18:45:01,208 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49100, dest: /127.0.0.1:54365, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2807215931494117822_1366, duration: 1853862
2013-10-31 18:45:01,208 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2807215931494117822_1366 terminating
2013-10-31 18:45:01,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51728, dest: /127.0.0.1:34578, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2807215931494117822_1366, duration: 2226294
2013-10-31 18:45:01,209 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2807215931494117822_1366 terminating
2013-10-31 18:45:01,210 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2807215931494117822_1366 size 51
2013-10-31 18:45:01,211 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:01,211 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:01,211 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2807215931494117822_1366 size 51
2013-10-31 18:45:01,212 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2807215931494117822_1366 size 51
2013-10-31 18:45:01,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0	dst=null	perm=null
2013-10-31 18:45:01,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:01,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:01,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:01,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:01,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0	dst=null	perm=null
2013-10-31 18:45:01,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:01,305 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:01,305 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000001_0 0.0% 
2013-10-31 18:45:01,426 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003. blk_8966755758663425826_1367
2013-10-31 18:45:01,447 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002. blk_7218987559097650147_1367
2013-10-31 18:45:01,456 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8966755758663425826_1367 src: /127.0.0.1:49102 dest: /127.0.0.1:54365
2013-10-31 18:45:01,457 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8966755758663425826_1367 src: /127.0.0.1:44930 dest: /127.0.0.1:59471
2013-10-31 18:45:01,458 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8966755758663425826_1367 src: /127.0.0.1:48822 dest: /127.0.0.1:37740
2013-10-31 18:45:01,460 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48822, dest: /127.0.0.1:37740, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8966755758663425826_1367, duration: 1044830
2013-10-31 18:45:01,460 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8966755758663425826_1367 terminating
2013-10-31 18:45:01,460 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8966755758663425826_1367 size 37
2013-10-31 18:45:01,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44930, dest: /127.0.0.1:59471, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8966755758663425826_1367, duration: 1463273
2013-10-31 18:45:01,461 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8966755758663425826_1367 terminating
2013-10-31 18:45:01,461 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8966755758663425826_1367 size 37
2013-10-31 18:45:01,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49102, dest: /127.0.0.1:54365, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8966755758663425826_1367, duration: 1864494
2013-10-31 18:45:01,461 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8966755758663425826_1367 terminating
2013-10-31 18:45:01,462 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:01,462 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:01,462 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8966755758663425826_1367 size 37
2013-10-31 18:45:01,471 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7218987559097650147_1367 src: /127.0.0.1:48820 dest: /127.0.0.1:37740
2013-10-31 18:45:01,472 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7218987559097650147_1367 src: /127.0.0.1:49106 dest: /127.0.0.1:54365
2013-10-31 18:45:01,473 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7218987559097650147_1367 src: /127.0.0.1:44933 dest: /127.0.0.1:59471
2013-10-31 18:45:01,475 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44933, dest: /127.0.0.1:59471, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7218987559097650147_1367, duration: 1473250
2013-10-31 18:45:01,475 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7218987559097650147_1367 terminating
2013-10-31 18:45:01,475 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7218987559097650147_1367 size 52
2013-10-31 18:45:01,475 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49106, dest: /127.0.0.1:54365, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7218987559097650147_1367, duration: 1670643
2013-10-31 18:45:01,476 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7218987559097650147_1367 terminating
2013-10-31 18:45:01,476 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48820, dest: /127.0.0.1:37740, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7218987559097650147_1367, duration: 2058474
2013-10-31 18:45:01,476 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7218987559097650147_1367 terminating
2013-10-31 18:45:01,477 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:01,477 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:01,480 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7218987559097650147_1367 size 52
2013-10-31 18:45:01,480 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7218987559097650147_1367 size 52
2013-10-31 18:45:01,511 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:01,512 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000003_0 0.0% 
2013-10-31 18:45:01,525 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:01,526 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000002_0 0.0% 
2013-10-31 18:45:01,718 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:01,720 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:01,721 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:02,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0	dst=null	perm=null
2013-10-31 18:45:02,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:02,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:02,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0	dst=null	perm=null
2013-10-31 18:45:02,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0	dst=null	perm=null
2013-10-31 18:45:02,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:02,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:02,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0	dst=null	perm=null
2013-10-31 18:45:02,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0	dst=null	perm=null
2013-10-31 18:45:02,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:02,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:02,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0	dst=null	perm=null
2013-10-31 18:45:02,805 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:45:02,807 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000000_0 is done.
2013-10-31 18:45:02,808 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000000_0  was -1
2013-10-31 18:45:02,808 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:02,924 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0036_m_000005_0
2013-10-31 18:45:02,924 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0036_m_000005_0
2013-10-31 18:45:02,924 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000005_0 not found in cache
2013-10-31 18:45:03,839 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:45:03,840 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000001_0 is done.
2013-10-31 18:45:03,840 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000001_0  was -1
2013-10-31 18:45:03,840 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:03,874 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:45:03,875 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000003_0 is done.
2013-10-31 18:45:03,875 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000003_0  was -1
2013-10-31 18:45:03,875 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:03,891 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:45:03,892 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000002_0 is done.
2013-10-31 18:45:03,892 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000002_0  was -1
2013-10-31 18:45:03,892 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:03,928 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000000_0' has completed task_20131031182606197_0036_m_000000 successfully.
2013-10-31 18:45:04,720 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000002_0' has completed task_20131031182606197_0036_m_000002 successfully.
2013-10-31 18:45:04,722 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000001_0' has completed task_20131031182606197_0036_m_000001 successfully.
2013-10-31 18:45:04,725 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000003_0' has completed task_20131031182606197_0036_m_000003 successfully.
2013-10-31 18:45:04,726 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0036_m_000004_0' to tip task_20131031182606197_0036_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:45:04,727 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:45:04,727 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000004_0 which needs 1 slots
2013-10-31 18:45:04,727 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000004_0 which needs 1 slots
2013-10-31 18:45:05,124 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-82572748
2013-10-31 18:45:05,126 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-82572748 spawned.
2013-10-31 18:45:05,129 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000004_0/taskjvm.sh
2013-10-31 18:45:06,192 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-82572748 given task: attempt_20131031182606197_0036_m_000004_0
2013-10-31 18:45:06,684 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000004_0 0.0% 
2013-10-31 18:45:06,687 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1926 Total time for transactions(ms): 35Number of transactions batched in Syncs: 160 Number of syncs: 1356 SyncTimes(ms): 80101 18497 
2013-10-31 18:45:06,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary	dst=null	perm=null
2013-10-31 18:45:06,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:06,709 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_SUCCESS from client DFSClient_attempt_20131031182606197_0036_m_000004_0
2013-10-31 18:45:06,709 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0036_m_000004_0
2013-10-31 18:45:06,714 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:06,715 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:06,716 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1705170389491270417 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:06,716 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1705170389491270417 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:06,716 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1705170389491270417 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,716 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3392666785987107417 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,716 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3392666785987107417 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:06,716 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3392666785987107417 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:07,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036	dst=null	perm=null
2013-10-31 18:45:07,590 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_3392666785987107417_1360 blk_1418774395172716651_1357 blk_8337267597493363863_1358
2013-10-31 18:45:07,590 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_1418774395172716651_1357 blk_-1705170389491270417_1359 blk_8337267597493363863_1358
2013-10-31 18:45:09,011 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1705170389491270417_1359 file build/test/data/dfs/data/data6/current/blk_-1705170389491270417 for deletion
2013-10-31 18:45:09,011 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data5/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:09,012 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1705170389491270417_1359 at file build/test/data/dfs/data/data6/current/blk_-1705170389491270417
2013-10-31 18:45:09,012 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data5/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:09,012 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data5/current/blk_1418774395172716651
2013-10-31 18:45:09,013 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data5/current/blk_8337267597493363863
2013-10-31 18:45:09,408 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data1/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:09,408 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3392666785987107417_1360 file build/test/data/dfs/data/data1/current/blk_3392666785987107417 for deletion
2013-10-31 18:45:09,408 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data1/current/blk_1418774395172716651
2013-10-31 18:45:09,408 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data2/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:09,409 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3392666785987107417_1360 at file build/test/data/dfs/data/data1/current/blk_3392666785987107417
2013-10-31 18:45:09,409 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data2/current/blk_8337267597493363863
2013-10-31 18:45:09,619 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000004_0 0.0% cleanup
2013-10-31 18:45:09,621 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000004_0 is done.
2013-10-31 18:45:09,621 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000004_0  was -1
2013-10-31 18:45:09,622 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:10,591 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_3392666785987107417_1360 blk_1418774395172716651_1357 blk_-1705170389491270417_1359 blk_8337267597493363863_1358
2013-10-31 18:45:10,591 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_3392666785987107417_1360 blk_1418774395172716651_1357 blk_-1705170389491270417_1359 blk_8337267597493363863_1358
2013-10-31 18:45:10,733 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000004_0' has completed task_20131031182606197_0036_m_000004 successfully.
2013-10-31 18:45:10,733 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0036 has completed successfully.
2013-10-31 18:45:10,734 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0036,submitTime=1383245090478,launchTime=1383245090991,firstMapTaskLaunchTime=1383245097920,firstJobSetupTaskLaunchTime=1383245091905,firstJobCleanupTaskLaunchTime=1383245104726,finishTime=1383245110733,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5EB2C8475D4643F9AA8F0AF69323B4BC/38EBDF9351644F09B3E885871A6D1E25] test/(1/1) ...ldedpipesplatform/replace
2013-10-31 18:45:10,738 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09. blk_-5396516443837207735_1368
2013-10-31 18:45:10,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5396516443837207735_1368 src: /127.0.0.1:44941 dest: /127.0.0.1:59471
2013-10-31 18:45:10,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5396516443837207735_1368 src: /127.0.0.1:48833 dest: /127.0.0.1:37740
2013-10-31 18:45:10,743 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5396516443837207735_1368 src: /127.0.0.1:51746 dest: /127.0.0.1:34578
2013-10-31 18:45:10,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51746, dest: /127.0.0.1:34578, bytes: 22669, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5396516443837207735_1368, duration: 993209
2013-10-31 18:45:10,745 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5396516443837207735_1368 terminating
2013-10-31 18:45:10,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48833, dest: /127.0.0.1:37740, bytes: 22669, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5396516443837207735_1368, duration: 1093381
2013-10-31 18:45:10,745 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5396516443837207735_1368 terminating
2013-10-31 18:45:10,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44941, dest: /127.0.0.1:59471, bytes: 22669, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5396516443837207735_1368, duration: 1070235
2013-10-31 18:45:10,746 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5396516443837207735_1368 terminating
2013-10-31 18:45:10,750 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5396516443837207735_1368 size 22669
2013-10-31 18:45:10,750 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 from client DFSClient_-471295458
2013-10-31 18:45:10,751 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 is closed by DFSClient_-471295458
2013-10-31 18:45:10,751 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5396516443837207735_1368 size 22669
2013-10-31 18:45:10,751 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5396516443837207735_1368 size 22669
2013-10-31 18:45:10,760 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:10,760 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000003_0'
2013-10-31 18:45:10,760 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000004_0'
2013-10-31 18:45:10,761 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2610187700968762386 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:10,761 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2610187700968762386 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:10,761 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2610187700968762386 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:10,766 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary
2013-10-31 18:45:10,767 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0036_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:10,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036	dst=null	perm=null
2013-10-31 18:45:10,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace	dst=null	perm=null
2013-10-31 18:45:10,824 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:10,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000	dst=null	perm=null
2013-10-31 18:45:10,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001	dst=null	perm=null
2013-10-31 18:45:10,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002	dst=null	perm=null
2013-10-31 18:45:10,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003	dst=null	perm=null
2013-10-31 18:45:10,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000	dst=null	perm=null
2013-10-31 18:45:10,833 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48836, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_60333104980117936_1364, duration: 289239
2013-10-31 18:45:10,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001	dst=null	perm=null
2013-10-31 18:45:10,837 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48837, bytes: 55, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2807215931494117822_1366, duration: 267950
2013-10-31 18:45:10,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002	dst=null	perm=null
2013-10-31 18:45:10,840 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48839, bytes: 56, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7218987559097650147_1367, duration: 269922
2013-10-31 18:45:10,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003	dst=null	perm=null
2013-10-31 18:45:10,843 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49123, bytes: 41, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8966755758663425826_1367, duration: 251815
2013-10-31 18:45:10,844 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/replace
2013-10-31 18:45:10,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace	dst=null	perm=null
2013-10-31 18:45:10,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000	dst=null	perm=null
2013-10-31 18:45:10,852 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51753, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_60333104980117936_1364, duration: 256681
2013-10-31 18:45:10,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001	dst=null	perm=null
2013-10-31 18:45:10,856 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51754, bytes: 55, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2807215931494117822_1366, duration: 251020
2013-10-31 18:45:10,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002	dst=null	perm=null
2013-10-31 18:45:10,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48843, bytes: 56, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7218987559097650147_1367, duration: 265686
2013-10-31 18:45:10,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003	dst=null	perm=null
2013-10-31 18:45:10,864 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44953, bytes: 41, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8966755758663425826_1367, duration: 260093
2013-10-31 18:45:10,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:10,874 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt. blk_-8747971817366002935_1369
2013-10-31 18:45:10,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8747971817366002935_1369 src: /127.0.0.1:44954 dest: /127.0.0.1:59471
2013-10-31 18:45:10,877 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8747971817366002935_1369 src: /127.0.0.1:49129 dest: /127.0.0.1:54365
2013-10-31 18:45:10,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8747971817366002935_1369 src: /127.0.0.1:51759 dest: /127.0.0.1:34578
2013-10-31 18:45:10,882 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51759, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8747971817366002935_1369, duration: 260076
2013-10-31 18:45:10,883 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8747971817366002935_1369 terminating
2013-10-31 18:45:10,883 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49129, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8747971817366002935_1369, duration: 1131126
2013-10-31 18:45:10,883 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8747971817366002935_1369 terminating
2013-10-31 18:45:10,884 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44954, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8747971817366002935_1369, duration: 2040414
2013-10-31 18:45:10,884 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8747971817366002935_1369 size 40
2013-10-31 18:45:10,884 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8747971817366002935_1369 terminating
2013-10-31 18:45:10,888 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8747971817366002935_1369 size 40
2013-10-31 18:45:10,888 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt from client DFSClient_-1596270109
2013-10-31 18:45:10,888 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt is closed by DFSClient_-1596270109
2013-10-31 18:45:10,889 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8747971817366002935_1369 size 40
2013-10-31 18:45:10,911 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:45:10,912 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:45:10,922 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:45:10,922 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt"]
2013-10-31 18:45:10,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size"]
2013-10-31 18:45:10,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:45:10,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:45:10,923 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:45:10,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...esplatform/ungrouped_size
2013-10-31 18:45:10,927 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:45:10,927 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:45:10,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:10,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:45:10,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:10,947 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar. blk_4969057808391450845_1370
2013-10-31 18:45:10,949 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:51760 dest: /127.0.0.1:34578
2013-10-31 18:45:10,950 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:44958 dest: /127.0.0.1:59471
2013-10-31 18:45:10,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:49133 dest: /127.0.0.1:54365
2013-10-31 18:45:10,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49133, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4969057808391450845_1370, duration: 3938651
2013-10-31 18:45:10,960 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4969057808391450845_1370 terminating
2013-10-31 18:45:10,960 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:10,960 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44958, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4969057808391450845_1370, duration: 4741355
2013-10-31 18:45:10,961 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4969057808391450845_1370 terminating
2013-10-31 18:45:10,961 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51760, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4969057808391450845_1370, duration: 5797523
2013-10-31 18:45:10,961 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4969057808391450845_1370 terminating
2013-10-31 18:45:10,963 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar from client DFSClient_-1596270109
2013-10-31 18:45:10,964 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:45:10,964 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:10,965 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:10,969 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar. New replication is 10
2013-10-31 18:45:10,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=null
2013-10-31 18:45:10,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:10,984 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:45:10,988 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:45:10,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt	dst=null	perm=null
2013-10-31 18:45:10,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,002 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split. New replication is 10
2013-10-31 18:45:11,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=null
2013-10-31 18:45:11,008 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split. blk_-8554828205108058155_1371
2013-10-31 18:45:11,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:44960 dest: /127.0.0.1:59471
2013-10-31 18:45:11,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:49135 dest: /127.0.0.1:54365
2013-10-31 18:45:11,013 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:51765 dest: /127.0.0.1:34578
2013-10-31 18:45:11,015 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:48854 dest: /127.0.0.1:37740
2013-10-31 18:45:11,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48854, dest: /127.0.0.1:37740, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8554828205108058155_1371, duration: 100238
2013-10-31 18:45:11,018 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51765, dest: /127.0.0.1:34578, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8554828205108058155_1371, duration: 1032174
2013-10-31 18:45:11,019 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,020 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49135, dest: /127.0.0.1:54365, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8554828205108058155_1371, duration: 2037827
2013-10-31 18:45:11,021 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,021 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44960, dest: /127.0.0.1:59471, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8554828205108058155_1371, duration: 3141560
2013-10-31 18:45:11,021 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,023 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,023 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split from client DFSClient_-1596270109
2013-10-31 18:45:11,024 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split is closed by DFSClient_-1596270109
2013-10-31 18:45:11,024 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,025 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,026 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,044 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo. blk_-2128509859462032642_1372
2013-10-31 18:45:11,045 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2128509859462032642_1372 src: /127.0.0.1:48855 dest: /127.0.0.1:37740
2013-10-31 18:45:11,047 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2128509859462032642_1372 src: /127.0.0.1:49139 dest: /127.0.0.1:54365
2013-10-31 18:45:11,048 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2128509859462032642_1372 src: /127.0.0.1:44966 dest: /127.0.0.1:59471
2013-10-31 18:45:11,051 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44966, dest: /127.0.0.1:59471, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2128509859462032642_1372, duration: 69761
2013-10-31 18:45:11,051 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2128509859462032642_1372 terminating
2013-10-31 18:45:11,052 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49139, dest: /127.0.0.1:54365, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2128509859462032642_1372, duration: 935170
2013-10-31 18:45:11,052 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2128509859462032642_1372 terminating
2013-10-31 18:45:11,053 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48855, dest: /127.0.0.1:37740, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2128509859462032642_1372, duration: 1740324
2013-10-31 18:45:11,053 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2128509859462032642_1372 terminating
2013-10-31 18:45:11,055 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2128509859462032642_1372 size 148
2013-10-31 18:45:11,055 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:45:11,056 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:45:11,056 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2128509859462032642_1372 size 148
2013-10-31 18:45:11,056 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2128509859462032642_1372 size 148
2013-10-31 18:45:11,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,083 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml. blk_-1951060055773038883_1373
2013-10-31 18:45:11,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1951060055773038883_1373 src: /127.0.0.1:48858 dest: /127.0.0.1:37740
2013-10-31 18:45:11,085 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1951060055773038883_1373 src: /127.0.0.1:49142 dest: /127.0.0.1:54365
2013-10-31 18:45:11,086 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1951060055773038883_1373 src: /127.0.0.1:51772 dest: /127.0.0.1:34578
2013-10-31 18:45:11,088 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51772, dest: /127.0.0.1:34578, bytes: 27503, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1951060055773038883_1373, duration: 1003287
2013-10-31 18:45:11,088 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1951060055773038883_1373 terminating
2013-10-31 18:45:11,088 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49142, dest: /127.0.0.1:54365, bytes: 27503, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1951060055773038883_1373, duration: 1225521
2013-10-31 18:45:11,089 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1951060055773038883_1373 size 27503
2013-10-31 18:45:11,089 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48858, dest: /127.0.0.1:37740, bytes: 27503, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 1309432
2013-10-31 18:45:11,089 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1951060055773038883_1373 terminating
2013-10-31 18:45:11,089 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1951060055773038883_1373 terminating
2013-10-31 18:45:11,092 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1951060055773038883_1373 size 27503
2013-10-31 18:45:11,092 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1951060055773038883_1373 size 27503
2013-10-31 18:45:11,092 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml from client DFSClient_-1596270109
2013-10-31 18:45:11,093 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:45:11,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1705170389491270417_1359 file build/test/data/dfs/data/data3/current/blk_-1705170389491270417 for deletion
2013-10-31 18:45:11,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data3/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:11,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1705170389491270417_1359 at file build/test/data/dfs/data/data3/current/blk_-1705170389491270417
2013-10-31 18:45:11,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3392666785987107417_1360 file build/test/data/dfs/data/data4/current/blk_3392666785987107417 for deletion
2013-10-31 18:45:11,284 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data3/current/blk_1418774395172716651
2013-10-31 18:45:11,284 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3392666785987107417_1360 at file build/test/data/dfs/data/data4/current/blk_3392666785987107417
2013-10-31 18:45:11,284 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data4/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:11,285 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data4/current/blk_8337267597493363863
2013-10-31 18:45:11,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=null
2013-10-31 18:45:11,993 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49145, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-287585837, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1951060055773038883_1373, duration: 405289
2013-10-31 18:45:12,012 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0037: nMaps=4 nReduces=0 max=-1
2013-10-31 18:45:12,012 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0037 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:45:12,012 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0037
2013-10-31 18:45:12,013 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0037
2013-10-31 18:45:12,012 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0037	RESULT=SUCCESS
2013-10-31 18:45:12,014 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0037
2013-10-31 18:45:12,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:12,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:12,035 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml. blk_-4204607545426031275_1375
2013-10-31 18:45:12,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4204607545426031275_1375 src: /127.0.0.1:44972 dest: /127.0.0.1:59471
2013-10-31 18:45:12,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4204607545426031275_1375 src: /127.0.0.1:51776 dest: /127.0.0.1:34578
2013-10-31 18:45:12,038 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4204607545426031275_1375 src: /127.0.0.1:48865 dest: /127.0.0.1:37740
2013-10-31 18:45:12,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48865, dest: /127.0.0.1:37740, bytes: 27568, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4204607545426031275_1375, duration: 1416573
2013-10-31 18:45:12,041 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4204607545426031275_1375 terminating
2013-10-31 18:45:12,041 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51776, dest: /127.0.0.1:34578, bytes: 27568, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4204607545426031275_1375, duration: 562742
2013-10-31 18:45:12,041 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4204607545426031275_1375 terminating
2013-10-31 18:45:12,042 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4204607545426031275_1375 size 27568
2013-10-31 18:45:12,042 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44972, dest: /127.0.0.1:59471, bytes: 27568, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4204607545426031275_1375, duration: 1148306
2013-10-31 18:45:12,042 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4204607545426031275_1375 size 27568
2013-10-31 18:45:12,042 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4204607545426031275_1375 terminating
2013-10-31 18:45:12,043 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml from client DFSClient_-287585837
2013-10-31 18:45:12,043 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml is closed by DFSClient_-287585837
2013-10-31 18:45:12,044 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4204607545426031275_1375 size 27568
2013-10-31 18:45:12,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:12,057 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken. blk_5370586274571019240_1376
2013-10-31 18:45:12,058 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5370586274571019240_1376 src: /127.0.0.1:48866 dest: /127.0.0.1:37740
2013-10-31 18:45:12,060 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5370586274571019240_1376 src: /127.0.0.1:44976 dest: /127.0.0.1:59471
2013-10-31 18:45:12,062 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5370586274571019240_1376 src: /127.0.0.1:49151 dest: /127.0.0.1:54365
2013-10-31 18:45:12,065 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49151, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5370586274571019240_1376, duration: 548149
2013-10-31 18:45:12,066 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5370586274571019240_1376 terminating
2013-10-31 18:45:12,066 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44976, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5370586274571019240_1376, duration: 1359594
2013-10-31 18:45:12,067 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5370586274571019240_1376 terminating
2013-10-31 18:45:12,067 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48866, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5370586274571019240_1376, duration: 2388692
2013-10-31 18:45:12,068 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5370586274571019240_1376 size 116
2013-10-31 18:45:12,068 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5370586274571019240_1376 terminating
2013-10-31 18:45:12,070 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5370586274571019240_1376 size 116
2013-10-31 18:45:12,070 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken from client DFSClient_-1596270109
2013-10-31 18:45:12,071 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:45:12,072 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5370586274571019240_1376 size 116
2013-10-31 18:45:12,081 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken
2013-10-31 18:45:12,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:45:12,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44978, bytes: 152, op: HDFS_READ, cliID: DFSClient_-287585837, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2128509859462032642_1372, duration: 318842
2013-10-31 18:45:12,086 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0037 = 40. Number of splits = 4
2013-10-31 18:45:12,087 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,087 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,087 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,090 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0037 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:45:12,090 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0037 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:45:12,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1705170389491270417_1359 file build/test/data/dfs/data/data8/current/blk_-1705170389491270417 for deletion
2013-10-31 18:45:12,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data8/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:12,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1705170389491270417_1359 at file build/test/data/dfs/data/data8/current/blk_-1705170389491270417
2013-10-31 18:45:12,482 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3392666785987107417_1360 file build/test/data/dfs/data/data7/current/blk_3392666785987107417 for deletion
2013-10-31 18:45:12,483 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data8/current/blk_1418774395172716651
2013-10-31 18:45:12,483 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3392666785987107417_1360 at file build/test/data/dfs/data/data7/current/blk_3392666785987107417
2013-10-31 18:45:12,483 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data7/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:12,484 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data7/current/blk_8337267597493363863
2013-10-31 18:45:12,938 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0037_m_000005_0' to tip task_20131031182606197_0037_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:12,942 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000000_0'
2013-10-31 18:45:12,942 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000005_0'
2013-10-31 18:45:12,944 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:45:12,944 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000005_0 which needs 1 slots
2013-10-31 18:45:12,945 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000005_0 which needs 1 slots
2013-10-31 18:45:12,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken	dst=null	perm=null
2013-10-31 18:45:12,952 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44979, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5370586274571019240_1376, duration: 273450
2013-10-31 18:45:12,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=null
2013-10-31 18:45:12,962 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48872, bytes: 27719, op: HDFS_READ, cliID: DFSClient_75958969, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 387903
2013-10-31 18:45:12,992 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:13,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=null
2013-10-31 18:45:13,023 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44982, bytes: 239915, op: HDFS_READ, cliID: DFSClient_75958969, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4969057808391450845_1370, duration: 1187778
2013-10-31 18:45:13,113 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0036_m_-1876538490
2013-10-31 18:45:13,123 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5595 with signal TERM. Exit code 0
2013-10-31 18:45:13,123 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_1315758328
2013-10-31 18:45:13,124 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_1315758328 spawned.
2013-10-31 18:45:13,127 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000005_0/taskjvm.sh
2013-10-31 18:45:13,326 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_4155904879908459364_1040
2013-10-31 18:45:13,592 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_4969057808391450845_1370 to datanode(s) 127.0.0.1:37740
2013-10-31 18:45:13,592 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-2610187700968762386_1363
2013-10-31 18:45:13,592 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-2610187700968762386_1363
2013-10-31 18:45:13,601 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:13,601 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:13,601 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:13,601 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-1876538490 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:13,731 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000001_0'
2013-10-31 18:45:13,732 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000002_0'
2013-10-31 18:45:14,283 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2610187700968762386_1363 file build/test/data/dfs/data/data4/current/blk_-2610187700968762386 for deletion
2013-10-31 18:45:14,284 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2610187700968762386_1363 at file build/test/data/dfs/data/data4/current/blk_-2610187700968762386
2013-10-31 18:45:14,363 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_1315758328 given task: attempt_20131031182606197_0037_m_000005_0
2013-10-31 18:45:14,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:15,013 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_4969057808391450845_1370 to 127.0.0.1:37740 
2013-10-31 18:45:15,015 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:48877 dest: /127.0.0.1:37740
2013-10-31 18:45:15,015 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_4969057808391450845_1370 to /127.0.0.1:37740
2013-10-31 18:45:15,018 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_4969057808391450845_1370 src: /127.0.0.1:48877 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:45:15,023 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:15,410 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2610187700968762386_1363 file build/test/data/dfs/data/data2/current/blk_-2610187700968762386 for deletion
2013-10-31 18:45:15,410 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2610187700968762386_1363 at file build/test/data/dfs/data/data2/current/blk_-2610187700968762386
2013-10-31 18:45:15,761 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:15,762 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000003_0 not found in cache
2013-10-31 18:45:15,762 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000004_0 not found in cache
2013-10-31 18:45:15,763 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331515762
2013-10-31 18:45:16,193 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-82572748 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:16,204 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6406 with signal TERM. Exit code 0
2013-10-31 18:45:16,379 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:16,380 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:16,380 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:16,380 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-82572748 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:16,424 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-2092873717 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:16,434 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5721 with signal TERM. Exit code 0
2013-10-31 18:45:16,593 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-2610187700968762386_1363
2013-10-31 18:45:16,624 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:16,624 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:16,624 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:16,625 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-2092873717 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:17,782 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000005_0 0.0% setup
2013-10-31 18:45:17,785 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000005_0 is done.
2013-10-31 18:45:17,785 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000005_0  was -1
2013-10-31 18:45:17,785 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:17,945 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:17,945 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000000_0 not found in cache
2013-10-31 18:45:17,946 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331517945
2013-10-31 18:45:18,014 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2610187700968762386_1363 file build/test/data/dfs/data/data6/current/blk_-2610187700968762386 for deletion
2013-10-31 18:45:18,014 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2610187700968762386_1363 at file build/test/data/dfs/data/data6/current/blk_-2610187700968762386
2013-10-31 18:45:18,261 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_1321699708 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:18,270 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5425 with signal TERM. Exit code 0
2013-10-31 18:45:18,530 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:18,530 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:18,531 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:18,532 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_1321699708 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:18,731 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:18,732 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000001_0 not found in cache
2013-10-31 18:45:18,732 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331518732
2013-10-31 18:45:18,732 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:18,733 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000002_0 not found in cache
2013-10-31 18:45:18,734 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331518734
2013-10-31 18:45:18,950 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000005_0' has completed task_20131031182606197_0037_m_000005 successfully.
2013-10-31 18:45:18,955 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000000_0' to tip task_20131031182606197_0037_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:18,956 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000000
2013-10-31 18:45:18,958 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:45:18,958 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000000_0 which needs 1 slots
2013-10-31 18:45:18,958 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000000_0 which needs 1 slots
2013-10-31 18:45:18,995 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_-1272420910
2013-10-31 18:45:18,996 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_-1272420910 spawned.
2013-10-31 18:45:18,998 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000000_0/taskjvm.sh
2013-10-31 18:45:19,402 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-1109083427 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:19,410 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5690 with signal TERM. Exit code 0
2013-10-31 18:45:19,446 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-1832274535 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:19,450 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5720 with signal TERM. Exit code 0
2013-10-31 18:45:19,576 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:19,576 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:19,576 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:19,576 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-1109083427 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:19,608 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:19,608 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:19,608 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:19,608 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-1832274535 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:19,738 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000001_0' to tip task_20131031182606197_0037_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:45:19,738 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000001
2013-10-31 18:45:19,739 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000002_0' to tip task_20131031182606197_0037_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:19,740 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:45:19,740 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000002
2013-10-31 18:45:19,740 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000001_0 which needs 1 slots
2013-10-31 18:45:19,741 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000001_0 which needs 1 slots
2013-10-31 18:45:19,741 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:45:19,742 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000002_0 which needs 1 slots
2013-10-31 18:45:19,742 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000002_0 which needs 1 slots
2013-10-31 18:45:19,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken	dst=null	perm=null
2013-10-31 18:45:19,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken	dst=null	perm=null
2013-10-31 18:45:19,746 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44988, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5370586274571019240_1376, duration: 146872
2013-10-31 18:45:19,759 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48881, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5370586274571019240_1376, duration: 146790
2013-10-31 18:45:19,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=null
2013-10-31 18:45:19,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=null
2013-10-31 18:45:19,763 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48883, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-2140004092, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 156425
2013-10-31 18:45:19,764 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48884, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-722249252, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 167048
2013-10-31 18:45:19,769 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000003_0' to tip task_20131031182606197_0037_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:45:19,769 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000003
2013-10-31 18:45:19,770 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:45:19,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000003_0 which needs 1 slots
2013-10-31 18:45:19,770 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000003_0 which needs 1 slots
2013-10-31 18:45:19,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken	dst=null	perm=null
2013-10-31 18:45:19,773 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49168, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5370586274571019240_1376, duration: 127823
2013-10-31 18:45:19,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml	dst=null	perm=null
2013-10-31 18:45:19,779 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:19,780 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:19,780 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48887, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-1213225089, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 163255
2013-10-31 18:45:19,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=null
2013-10-31 18:45:19,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=null
2013-10-31 18:45:19,794 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:19,796 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49171, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2140004092, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4969057808391450845_1370, duration: 753739
2013-10-31 18:45:19,796 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48889, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-722249252, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4969057808391450845_1370, duration: 712502
2013-10-31 18:45:19,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar	dst=null	perm=null
2013-10-31 18:45:19,808 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44999, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1213225089, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4969057808391450845_1370, duration: 585773
2013-10-31 18:45:19,854 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_1256737587
2013-10-31 18:45:19,855 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_1256737587 spawned.
2013-10-31 18:45:19,855 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_-1087900185
2013-10-31 18:45:19,855 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_-1087900185 spawned.
2013-10-31 18:45:19,857 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000001_0/taskjvm.sh
2013-10-31 18:45:19,857 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000002_0/taskjvm.sh
2013-10-31 18:45:19,859 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_-1272420910 given task: attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:19,863 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_-116763129
2013-10-31 18:45:19,864 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_-116763129 spawned.
2013-10-31 18:45:19,865 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000003_0/taskjvm.sh
2013-10-31 18:45:21,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=null
2013-10-31 18:45:21,072 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45001, bytes: 1447, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8554828205108058155_1371, duration: 173780
2013-10-31 18:45:21,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt	dst=null	perm=null
2013-10-31 18:45:21,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:21,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:21,297 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49176, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8747971817366002935_1369, duration: 164107
2013-10-31 18:45:21,302 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000. blk_-1300939559458420103_1377
2013-10-31 18:45:21,326 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1300939559458420103_1377 src: /127.0.0.1:51806 dest: /127.0.0.1:34578
2013-10-31 18:45:21,327 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1300939559458420103_1377 src: /127.0.0.1:49178 dest: /127.0.0.1:54365
2013-10-31 18:45:21,328 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1300939559458420103_1377 src: /127.0.0.1:48896 dest: /127.0.0.1:37740
2013-10-31 18:45:21,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48896, dest: /127.0.0.1:37740, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1300939559458420103_1377, duration: 1522273
2013-10-31 18:45:21,331 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1300939559458420103_1377 terminating
2013-10-31 18:45:21,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49178, dest: /127.0.0.1:54365, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1300939559458420103_1377, duration: 1723227
2013-10-31 18:45:21,331 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1300939559458420103_1377 terminating
2013-10-31 18:45:21,332 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51806, dest: /127.0.0.1:34578, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1300939559458420103_1377, duration: 2271393
2013-10-31 18:45:21,332 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1300939559458420103_1377 terminating
2013-10-31 18:45:21,333 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1300939559458420103_1377 size 24
2013-10-31 18:45:21,333 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:21,333 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:21,333 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1300939559458420103_1377 size 24
2013-10-31 18:45:21,334 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1300939559458420103_1377 size 24
2013-10-31 18:45:21,385 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:21,385 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000000_0 0.0% 
2013-10-31 18:45:21,600 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_-1087900185 given task: attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:21,604 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_1256737587 given task: attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:21,609 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_-116763129 given task: attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:21,960 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:22,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=null
2013-10-31 18:45:22,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=null
2013-10-31 18:45:22,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split	dst=null	perm=null
2013-10-31 18:45:22,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45012, bytes: 1447, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8554828205108058155_1371, duration: 163453
2013-10-31 18:45:22,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49187, bytes: 931, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8554828205108058155_1371, duration: 152543
2013-10-31 18:45:22,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48905, bytes: 415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8554828205108058155_1371, duration: 121140
2013-10-31 18:45:22,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt	dst=null	perm=null
2013-10-31 18:45:22,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt	dst=null	perm=null
2013-10-31 18:45:22,143 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49189, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8747971817366002935_1369, duration: 120046
2013-10-31 18:45:22,143 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45016, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8747971817366002935_1369, duration: 114291
2013-10-31 18:45:22,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt	dst=null	perm=null
2013-10-31 18:45:22,146 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45017, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8747971817366002935_1369, duration: 117390
2013-10-31 18:45:22,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:22,385 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001. blk_-8381727752134553355_1380
2013-10-31 18:45:22,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0	dst=null	perm=null
2013-10-31 18:45:22,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,425 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8381727752134553355_1380 src: /127.0.0.1:49192 dest: /127.0.0.1:54365
2013-10-31 18:45:22,426 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8381727752134553355_1380 src: /127.0.0.1:51822 dest: /127.0.0.1:34578
2013-10-31 18:45:22,426 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8381727752134553355_1380 src: /127.0.0.1:45020 dest: /127.0.0.1:59471
2013-10-31 18:45:22,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45020, dest: /127.0.0.1:59471, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8381727752134553355_1380, duration: 959074
2013-10-31 18:45:22,429 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8381727752134553355_1380 terminating
2013-10-31 18:45:22,429 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51822, dest: /127.0.0.1:34578, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8381727752134553355_1380, duration: 1369553
2013-10-31 18:45:22,431 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8381727752134553355_1380 terminating
2013-10-31 18:45:22,431 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8381727752134553355_1380 size 12
2013-10-31 18:45:22,433 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49192, dest: /127.0.0.1:54365, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8381727752134553355_1380, duration: 5064119
2013-10-31 18:45:22,433 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8381727752134553355_1380 size 12
2013-10-31 18:45:22,433 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8381727752134553355_1380 terminating
2013-10-31 18:45:22,434 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:22,434 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:22,434 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8381727752134553355_1380 size 12
2013-10-31 18:45:23,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:23,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:23,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:23,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0	dst=null	perm=null
2013-10-31 18:45:23,648 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:23,648 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000001_0 0.0% 
2013-10-31 18:45:23,766 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003. blk_-9186458009821184877_1380
2013-10-31 18:45:23,767 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002. blk_3519506000020369794_1380
2013-10-31 18:45:23,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9186458009821184877_1380 src: /127.0.0.1:51824 dest: /127.0.0.1:34578
2013-10-31 18:45:23,789 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9186458009821184877_1380 src: /127.0.0.1:48914 dest: /127.0.0.1:37740
2013-10-31 18:45:23,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9186458009821184877_1380 src: /127.0.0.1:45024 dest: /127.0.0.1:59471
2013-10-31 18:45:23,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3519506000020369794_1380 src: /127.0.0.1:48913 dest: /127.0.0.1:37740
2013-10-31 18:45:23,791 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3519506000020369794_1380 src: /127.0.0.1:45025 dest: /127.0.0.1:59471
2013-10-31 18:45:23,792 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3519506000020369794_1380 src: /127.0.0.1:49200 dest: /127.0.0.1:54365
2013-10-31 18:45:23,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45024, dest: /127.0.0.1:59471, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9186458009821184877_1380, duration: 772312
2013-10-31 18:45:23,792 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9186458009821184877_1380 terminating
2013-10-31 18:45:23,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48914, dest: /127.0.0.1:37740, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9186458009821184877_1380, duration: 1110113
2013-10-31 18:45:23,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9186458009821184877_1380 terminating
2013-10-31 18:45:23,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51824, dest: /127.0.0.1:34578, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9186458009821184877_1380, duration: 1521710
2013-10-31 18:45:23,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9186458009821184877_1380 size 12
2013-10-31 18:45:23,793 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9186458009821184877_1380 terminating
2013-10-31 18:45:23,794 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9186458009821184877_1380 size 12
2013-10-31 18:45:23,794 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:23,795 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:23,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49200, dest: /127.0.0.1:54365, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3519506000020369794_1380, duration: 1129505
2013-10-31 18:45:23,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3519506000020369794_1380 terminating
2013-10-31 18:45:23,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45025, dest: /127.0.0.1:59471, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3519506000020369794_1380, duration: 1503374
2013-10-31 18:45:23,795 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3519506000020369794_1380 terminating
2013-10-31 18:45:23,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3519506000020369794_1380 size 12
2013-10-31 18:45:23,796 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48913, dest: /127.0.0.1:37740, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3519506000020369794_1380, duration: 1910655
2013-10-31 18:45:23,796 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9186458009821184877_1380 size 12
2013-10-31 18:45:23,796 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3519506000020369794_1380 terminating
2013-10-31 18:45:23,796 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3519506000020369794_1380 size 12
2013-10-31 18:45:23,797 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:23,797 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:23,797 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3519506000020369794_1380 size 12
2013-10-31 18:45:23,846 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:23,847 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000003_0 0.0% 
2013-10-31 18:45:23,854 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:23,854 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000002_0 0.0% 
2013-10-31 18:45:23,958 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0037_m_000005_0
2013-10-31 18:45:23,959 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0037_m_000005_0
2013-10-31 18:45:23,959 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000005_0 not found in cache
2013-10-31 18:45:23,996 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:0+10
2013-10-31 18:45:23,998 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000000_0 is done.
2013-10-31 18:45:23,998 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000000_0  was -1
2013-10-31 18:45:23,999 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:24,964 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000000_0' has completed task_20131031182606197_0037_m_000000 successfully.
2013-10-31 18:45:25,747 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:25,748 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:25,776 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:25,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0	dst=null	perm=null
2013-10-31 18:45:25,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:25,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0	dst=null	perm=null
2013-10-31 18:45:25,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:25,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:25,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0	dst=null	perm=null
2013-10-31 18:45:25,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:25,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0	dst=null	perm=null
2013-10-31 18:45:26,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0	dst=null	perm=null
2013-10-31 18:45:26,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:26,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:26,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0	dst=null	perm=null
2013-10-31 18:45:28,075 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:20+10
2013-10-31 18:45:28,076 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:10+10
2013-10-31 18:45:28,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:20+10
2013-10-31 18:45:28,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:30+10
2013-10-31 18:45:28,077 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000002_0 is done.
2013-10-31 18:45:28,077 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:10+10
2013-10-31 18:45:28,078 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000002_0  was -1
2013-10-31 18:45:28,078 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:28,078 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000001_0 is done.
2013-10-31 18:45:28,078 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000001_0  was -1
2013-10-31 18:45:28,078 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:28,079 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:30+10
2013-10-31 18:45:28,079 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000003_0 is done.
2013-10-31 18:45:28,079 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000003_0  was -1
2013-10-31 18:45:28,079 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:28,749 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000001_0' has completed task_20131031182606197_0037_m_000001 successfully.
2013-10-31 18:45:28,814 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000003_0' has completed task_20131031182606197_0037_m_000003 successfully.
2013-10-31 18:45:28,816 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000002_0' has completed task_20131031182606197_0037_m_000002 successfully.
2013-10-31 18:45:28,819 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0037_m_000004_0' to tip task_20131031182606197_0037_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:28,821 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:45:28,822 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000004_0 which needs 1 slots
2013-10-31 18:45:28,822 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000004_0 which needs 1 slots
2013-10-31 18:45:28,858 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_1185596558
2013-10-31 18:45:28,859 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_1185596558 spawned.
2013-10-31 18:45:28,861 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000004_0/taskjvm.sh
2013-10-31 18:45:29,704 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_1185596558 given task: attempt_20131031182606197_0037_m_000004_0
2013-10-31 18:45:30,201 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000004_0 0.0% 
2013-10-31 18:45:30,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary	dst=null	perm=null
2013-10-31 18:45:30,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:30,223 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_SUCCESS from client DFSClient_attempt_20131031182606197_0037_m_000004_0
2013-10-31 18:45:30,223 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0037_m_000004_0
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:30,230 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2128509859462032642 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2128509859462032642 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2128509859462032642 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1951060055773038883 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1951060055773038883 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,231 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1951060055773038883 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037	dst=null	perm=null
2013-10-31 18:45:31,595 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_4969057808391450845_1370 blk_-1951060055773038883_1373 blk_-8554828205108058155_1371
2013-10-31 18:45:31,596 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_4969057808391450845_1370 blk_-8554828205108058155_1371 blk_-2128509859462032642_1372
2013-10-31 18:45:33,018 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data5/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:33,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2128509859462032642_1372 file build/test/data/dfs/data/data6/current/blk_-2128509859462032642 for deletion
2013-10-31 18:45:33,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data6/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:33,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data5/current/blk_-8554828205108058155
2013-10-31 18:45:33,019 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2128509859462032642_1372 at file build/test/data/dfs/data/data6/current/blk_-2128509859462032642
2013-10-31 18:45:33,020 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data6/current/blk_4969057808391450845
2013-10-31 18:45:33,116 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000004_0 0.0% cleanup
2013-10-31 18:45:33,116 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000004_0 is done.
2013-10-31 18:45:33,117 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000004_0  was -1
2013-10-31 18:45:33,117 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:33,416 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data2/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:33,416 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1951060055773038883_1373 file build/test/data/dfs/data/data1/current/blk_-1951060055773038883 for deletion
2013-10-31 18:45:33,416 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data2/current/blk_-8554828205108058155
2013-10-31 18:45:33,417 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1951060055773038883_1373 at file build/test/data/dfs/data/data1/current/blk_-1951060055773038883
2013-10-31 18:45:33,417 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data1/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:33,417 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data1/current/blk_4969057808391450845
2013-10-31 18:45:34,596 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_4969057808391450845_1370 blk_-1951060055773038883_1373 blk_-8554828205108058155_1371 blk_-2128509859462032642_1372
2013-10-31 18:45:34,596 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_4969057808391450845_1370 blk_-1951060055773038883_1373 blk_-8554828205108058155_1371 blk_-2128509859462032642_1372
2013-10-31 18:45:34,829 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000004_0' has completed task_20131031182606197_0037_m_000004 successfully.
2013-10-31 18:45:34,830 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0037 has completed successfully.
2013-10-31 18:45:34,830 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0037,submitTime=1383245111983,launchTime=1383245112090,firstMapTaskLaunchTime=1383245118955,firstJobSetupTaskLaunchTime=1383245112938,firstJobCleanupTaskLaunchTime=1383245128818,finishTime=1383245134830,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[35F2C65797D24761B721335B4F0750B8/E9C2C135605D403F9213DC49DCB08C40] test/(1/1) ...esplatform/ungrouped_size
2013-10-31 18:45:34,837 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F. blk_-2748175481835955132_1381
2013-10-31 18:45:34,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2748175481835955132_1381 src: /127.0.0.1:45034 dest: /127.0.0.1:59471
2013-10-31 18:45:34,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2748175481835955132_1381 src: /127.0.0.1:51838 dest: /127.0.0.1:34578
2013-10-31 18:45:34,843 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2748175481835955132_1381 src: /127.0.0.1:49210 dest: /127.0.0.1:54365
2013-10-31 18:45:34,853 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49210, dest: /127.0.0.1:54365, bytes: 22657, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2748175481835955132_1381, duration: 4750006
2013-10-31 18:45:34,853 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2748175481835955132_1381 terminating
2013-10-31 18:45:34,854 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51838, dest: /127.0.0.1:34578, bytes: 22657, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2748175481835955132_1381, duration: 4036484
2013-10-31 18:45:34,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2748175481835955132_1381 terminating
2013-10-31 18:45:34,855 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2748175481835955132_1381 size 22657
2013-10-31 18:45:34,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45034, dest: /127.0.0.1:59471, bytes: 22657, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2748175481835955132_1381, duration: 7825117
2013-10-31 18:45:34,855 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2748175481835955132_1381 size 22657
2013-10-31 18:45:34,855 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2748175481835955132_1381 terminating
2013-10-31 18:45:34,859 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2748175481835955132_1381 size 22657
2013-10-31 18:45:34,860 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F from client DFSClient_-287585837
2013-10-31 18:45:34,860 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F is closed by DFSClient_-287585837
2013-10-31 18:45:34,868 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:34,869 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000002_0'
2013-10-31 18:45:34,869 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000004_0'
2013-10-31 18:45:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5370586274571019240 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5370586274571019240 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:34,871 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5370586274571019240 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:34,875 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0037_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:34,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037	dst=null	perm=null
2013-10-31 18:45:34,877 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary
2013-10-31 18:45:34,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=null
2013-10-31 18:45:34,907 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:34,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000	dst=null	perm=null
2013-10-31 18:45:34,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001	dst=null	perm=null
2013-10-31 18:45:34,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002	dst=null	perm=null
2013-10-31 18:45:34,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003	dst=null	perm=null
2013-10-31 18:45:34,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000	dst=null	perm=null
2013-10-31 18:45:34,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51841, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1300939559458420103_1377, duration: 302859
2013-10-31 18:45:34,913 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 201 raw values into 1 aggregated values, total 6
2013-10-31 18:45:34,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001	dst=null	perm=null
2013-10-31 18:45:34,915 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45039, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8381727752134553355_1380, duration: 275195
2013-10-31 18:45:34,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002	dst=null	perm=null
2013-10-31 18:45:34,917 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45040, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3519506000020369794_1380, duration: 262061
2013-10-31 18:45:34,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003	dst=null	perm=null
2013-10-31 18:45:34,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51844, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9186458009821184877_1380, duration: 260045
2013-10-31 18:45:34,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=null
2013-10-31 18:45:34,926 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:34,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000	dst=null	perm=null
2013-10-31 18:45:34,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001	dst=null	perm=null
2013-10-31 18:45:34,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002	dst=null	perm=null
2013-10-31 18:45:34,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003	dst=null	perm=null
2013-10-31 18:45:34,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000	dst=null	perm=null
2013-10-31 18:45:34,931 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51845, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1300939559458420103_1377, duration: 139765
2013-10-31 18:45:34,931 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/ungrouped_size
2013-10-31 18:45:34,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size	dst=null	perm=null
2013-10-31 18:45:34,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000	dst=null	perm=null
2013-10-31 18:45:34,935 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48934, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1300939559458420103_1377, duration: 141642
2013-10-31 18:45:34,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001	dst=null	perm=null
2013-10-31 18:45:34,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45044, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8381727752134553355_1380, duration: 133821
2013-10-31 18:45:34,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002	dst=null	perm=null
2013-10-31 18:45:34,940 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49219, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3519506000020369794_1380, duration: 133386
2013-10-31 18:45:34,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003	dst=null	perm=null
2013-10-31 18:45:34,943 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51849, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9186458009821184877_1380, duration: 147043
2013-10-31 18:45:34,952 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:45:34,953 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:45:34,962 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:45:34,963 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:45:34,963 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter"]
2013-10-31 18:45:34,963 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:45:34,964 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:45:34,964 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:45:34,965 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...eldedpipesplatform/filter
2013-10-31 18:45:34,968 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:45:34,969 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:45:34,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:34,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:45:34,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:34,995 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar. blk_-2859678223868609014_1382
2013-10-31 18:45:34,997 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:49221 dest: /127.0.0.1:54365
2013-10-31 18:45:34,998 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:48939 dest: /127.0.0.1:37740
2013-10-31 18:45:35,000 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:45049 dest: /127.0.0.1:59471
2013-10-31 18:45:35,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45049, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2859678223868609014_1382, duration: 4132787
2013-10-31 18:45:35,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2859678223868609014_1382 terminating
2013-10-31 18:45:35,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48939, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2859678223868609014_1382, duration: 5176959
2013-10-31 18:45:35,009 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2859678223868609014_1382 terminating
2013-10-31 18:45:35,010 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49221, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2859678223868609014_1382, duration: 6197168
2013-10-31 18:45:35,010 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2859678223868609014_1382 terminating
2013-10-31 18:45:35,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:35,013 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:35,014 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:35,291 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data3/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:35,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2128509859462032642_1372 file build/test/data/dfs/data/data4/current/blk_-2128509859462032642 for deletion
2013-10-31 18:45:35,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data3/current/blk_-8554828205108058155
2013-10-31 18:45:35,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2128509859462032642_1372 at file build/test/data/dfs/data/data4/current/blk_-2128509859462032642
2013-10-31 18:45:35,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1951060055773038883_1373 file build/test/data/dfs/data/data3/current/blk_-1951060055773038883 for deletion
2013-10-31 18:45:35,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data4/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:35,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1951060055773038883_1373 at file build/test/data/dfs/data/data3/current/blk_-1951060055773038883
2013-10-31 18:45:35,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data4/current/blk_4969057808391450845
2013-10-31 18:45:35,413 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar from client DFSClient_-1596270109
2013-10-31 18:45:35,413 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:45:35,422 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar. New replication is 10
2013-10-31 18:45:35,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=null
2013-10-31 18:45:35,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,437 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:45:35,442 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:45:35,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:35,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,460 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split. New replication is 10
2013-10-31 18:45:35,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=null
2013-10-31 18:45:35,468 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split. blk_7884357659738796485_1383
2013-10-31 18:45:35,469 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:49224 dest: /127.0.0.1:54365
2013-10-31 18:45:35,471 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:51854 dest: /127.0.0.1:34578
2013-10-31 18:45:35,473 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:45052 dest: /127.0.0.1:59471
2013-10-31 18:45:35,474 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:48944 dest: /127.0.0.1:37740
2013-10-31 18:45:35,478 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48944, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7884357659738796485_1383, duration: 875664
2013-10-31 18:45:35,479 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,479 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45052, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7884357659738796485_1383, duration: 1655952
2013-10-31 18:45:35,480 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,480 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51854, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7884357659738796485_1383, duration: 2608487
2013-10-31 18:45:35,481 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,481 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49224, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7884357659738796485_1383, duration: 3533755
2013-10-31 18:45:35,482 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,483 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,484 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split from client DFSClient_-1596270109
2013-10-31 18:45:35,484 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split is closed by DFSClient_-1596270109
2013-10-31 18:45:35,484 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,485 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,485 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,500 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo. blk_-4117612380754601010_1384
2013-10-31 18:45:35,501 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4117612380754601010_1384 src: /127.0.0.1:51857 dest: /127.0.0.1:34578
2013-10-31 18:45:35,503 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4117612380754601010_1384 src: /127.0.0.1:49229 dest: /127.0.0.1:54365
2013-10-31 18:45:35,505 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4117612380754601010_1384 src: /127.0.0.1:48947 dest: /127.0.0.1:37740
2013-10-31 18:45:35,508 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48947, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4117612380754601010_1384, duration: 544039
2013-10-31 18:45:35,508 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4117612380754601010_1384 terminating
2013-10-31 18:45:35,509 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49229, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4117612380754601010_1384, duration: 1326330
2013-10-31 18:45:35,509 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4117612380754601010_1384 terminating
2013-10-31 18:45:35,510 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4117612380754601010_1384 size 156
2013-10-31 18:45:35,510 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51857, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4117612380754601010_1384, duration: 2241253
2013-10-31 18:45:35,510 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4117612380754601010_1384 size 156
2013-10-31 18:45:35,511 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4117612380754601010_1384 terminating
2013-10-31 18:45:35,513 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:45:35,513 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:45:35,513 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4117612380754601010_1384 size 156
2013-10-31 18:45:35,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,539 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml. blk_5343639107369864272_1385
2013-10-31 18:45:35,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5343639107369864272_1385 src: /127.0.0.1:48948 dest: /127.0.0.1:37740
2013-10-31 18:45:35,542 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5343639107369864272_1385 src: /127.0.0.1:49232 dest: /127.0.0.1:54365
2013-10-31 18:45:35,543 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5343639107369864272_1385 src: /127.0.0.1:45059 dest: /127.0.0.1:59471
2013-10-31 18:45:35,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45059, dest: /127.0.0.1:59471, bytes: 27287, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5343639107369864272_1385, duration: 2564869
2013-10-31 18:45:35,550 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5343639107369864272_1385 terminating
2013-10-31 18:45:35,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49232, dest: /127.0.0.1:54365, bytes: 27287, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 2758287
2013-10-31 18:45:35,551 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5343639107369864272_1385 terminating
2013-10-31 18:45:35,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48948, dest: /127.0.0.1:37740, bytes: 27287, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5343639107369864272_1385, duration: 4298558
2013-10-31 18:45:35,552 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5343639107369864272_1385 terminating
2013-10-31 18:45:35,553 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5343639107369864272_1385 size 27287
2013-10-31 18:45:35,553 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml from client DFSClient_-1596270109
2013-10-31 18:45:35,554 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:45:35,554 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5343639107369864272_1385 size 27287
2013-10-31 18:45:35,555 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5343639107369864272_1385 size 27287
2013-10-31 18:45:35,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=null
2013-10-31 18:45:35,571 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49235, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 393915
2013-10-31 18:45:35,590 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0038: nMaps=4 nReduces=0 max=-1
2013-10-31 18:45:35,590 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0038 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:45:35,590 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0038
2013-10-31 18:45:35,591 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0038	RESULT=SUCCESS
2013-10-31 18:45:35,591 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0038
2013-10-31 18:45:35,592 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0038
2013-10-31 18:45:36,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:36,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:36,135 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml. blk_-5380214336378028840_1387
2013-10-31 18:45:36,137 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5380214336378028840_1387 src: /127.0.0.1:48954 dest: /127.0.0.1:37740
2013-10-31 18:45:36,139 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5380214336378028840_1387 src: /127.0.0.1:45064 dest: /127.0.0.1:59471
2013-10-31 18:45:36,141 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5380214336378028840_1387 src: /127.0.0.1:51868 dest: /127.0.0.1:34578
2013-10-31 18:45:36,145 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51868, dest: /127.0.0.1:34578, bytes: 27352, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5380214336378028840_1387, duration: 213085
2013-10-31 18:45:36,145 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5380214336378028840_1387 terminating
2013-10-31 18:45:36,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45064, dest: /127.0.0.1:59471, bytes: 27352, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5380214336378028840_1387, duration: 972624
2013-10-31 18:45:36,146 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5380214336378028840_1387 terminating
2013-10-31 18:45:36,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48954, dest: /127.0.0.1:37740, bytes: 27352, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5380214336378028840_1387, duration: 1843332
2013-10-31 18:45:36,147 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5380214336378028840_1387 terminating
2013-10-31 18:45:36,149 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5380214336378028840_1387 size 27352
2013-10-31 18:45:36,149 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml from client DFSClient_-1107235254
2013-10-31 18:45:36,150 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml is closed by DFSClient_-1107235254
2013-10-31 18:45:36,150 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5380214336378028840_1387 size 27352
2013-10-31 18:45:36,150 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5380214336378028840_1387 size 27352
2013-10-31 18:45:36,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:36,164 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken. blk_-1757874773394060354_1388
2013-10-31 18:45:36,166 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1757874773394060354_1388 src: /127.0.0.1:45066 dest: /127.0.0.1:59471
2013-10-31 18:45:36,168 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1757874773394060354_1388 src: /127.0.0.1:49241 dest: /127.0.0.1:54365
2013-10-31 18:45:36,169 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1757874773394060354_1388 src: /127.0.0.1:51871 dest: /127.0.0.1:34578
2013-10-31 18:45:36,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51871, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1757874773394060354_1388, duration: 69571
2013-10-31 18:45:36,172 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1757874773394060354_1388 terminating
2013-10-31 18:45:36,172 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1757874773394060354_1388 size 116
2013-10-31 18:45:36,173 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49241, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1757874773394060354_1388, duration: 850399
2013-10-31 18:45:36,173 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1757874773394060354_1388 size 116
2013-10-31 18:45:36,173 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1757874773394060354_1388 terminating
2013-10-31 18:45:36,174 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45066, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1757874773394060354_1388, duration: 1694015
2013-10-31 18:45:36,174 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1757874773394060354_1388 size 116
2013-10-31 18:45:36,174 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1757874773394060354_1388 terminating
2013-10-31 18:45:36,178 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken from client DFSClient_-1596270109
2013-10-31 18:45:36,179 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:45:36,185 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken
2013-10-31 18:45:36,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:45:36,189 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51872, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4117612380754601010_1384, duration: 281317
2013-10-31 18:45:36,190 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0038 = 1449. Number of splits = 4
2013-10-31 18:45:36,190 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0038 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:45:36,194 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0038 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:45:36,490 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data8/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:36,490 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2128509859462032642_1372 file build/test/data/dfs/data/data7/current/blk_-2128509859462032642 for deletion
2013-10-31 18:45:36,490 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data8/current/blk_-8554828205108058155
2013-10-31 18:45:36,490 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1951060055773038883_1373 file build/test/data/dfs/data/data8/current/blk_-1951060055773038883 for deletion
2013-10-31 18:45:36,490 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2128509859462032642_1372 at file build/test/data/dfs/data/data7/current/blk_-2128509859462032642
2013-10-31 18:45:36,491 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1951060055773038883_1373 at file build/test/data/dfs/data/data8/current/blk_-1951060055773038883
2013-10-31 18:45:36,491 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data7/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:36,492 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data7/current/blk_4969057808391450845
2013-10-31 18:45:36,982 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0038_m_000005_0' to tip task_20131031182606197_0038_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:36,986 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000000_0'
2013-10-31 18:45:36,986 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000005_0'
2013-10-31 18:45:36,989 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:45:36,989 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000005_0 which needs 1 slots
2013-10-31 18:45:36,989 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000005_0 which needs 1 slots
2013-10-31 18:45:36,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken	dst=null	perm=null
2013-10-31 18:45:36,997 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51873, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1757874773394060354_1388, duration: 266220
2013-10-31 18:45:37,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=null
2013-10-31 18:45:37,007 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49246, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-803009644, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 382199
2013-10-31 18:45:37,038 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:37,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=null
2013-10-31 18:45:37,066 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49247, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-803009644, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2859678223868609014_1382, duration: 1194577
2013-10-31 18:45:37,163 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0037_m_1315758328
2013-10-31 18:45:37,168 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6726 with signal TERM. Exit code 0
2013-10-31 18:45:37,168 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_-609775213
2013-10-31 18:45:37,169 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_-609775213 spawned.
2013-10-31 18:45:37,171 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000005_0/taskjvm.sh
2013-10-31 18:45:37,456 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:37,456 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:37,456 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:37,456 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_1315758328 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:37,597 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2859678223868609014_1382 to datanode(s) 127.0.0.1:34578
2013-10-31 18:45:37,598 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5370586274571019240_1376
2013-10-31 18:45:37,598 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5370586274571019240_1376
2013-10-31 18:45:37,822 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000001_0'
2013-10-31 18:45:37,824 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000003_0'
2013-10-31 18:45:38,245 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_-609775213 given task: attempt_20131031182606197_0038_m_000005_0
2013-10-31 18:45:38,292 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2859678223868609014_1382 to 127.0.0.1:34578 
2013-10-31 18:45:38,292 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5370586274571019240_1376 file build/test/data/dfs/data/data4/current/blk_5370586274571019240 for deletion
2013-10-31 18:45:38,293 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5370586274571019240_1376 at file build/test/data/dfs/data/data4/current/blk_5370586274571019240
2013-10-31 18:45:38,293 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2859678223868609014_1382 to /127.0.0.1:34578
2013-10-31 18:45:38,293 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:51878 dest: /127.0.0.1:34578
2013-10-31 18:45:38,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2859678223868609014_1382 src: /127.0.0.1:51878 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:45:38,301 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:38,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:39,021 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5370586274571019240_1376 file build/test/data/dfs/data/data6/current/blk_5370586274571019240 for deletion
2013-10-31 18:45:39,021 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5370586274571019240_1376 at file build/test/data/dfs/data/data6/current/blk_5370586274571019240
2013-10-31 18:45:39,871 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:39,871 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000004_0 not found in cache
2013-10-31 18:45:39,872 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000002_0 not found in cache
2013-10-31 18:45:39,872 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331539872
2013-10-31 18:45:40,599 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_5370586274571019240_1376
2013-10-31 18:45:40,610 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_-1087900185 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:40,621 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6976 with signal TERM. Exit code 0
2013-10-31 18:45:41,171 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_1185596558 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:41,181 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7205 with signal TERM. Exit code 0
2013-10-31 18:45:41,686 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000005_0 0.0% setup
2013-10-31 18:45:41,689 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000005_0 is done.
2013-10-31 18:45:41,690 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000005_0  was -1
2013-10-31 18:45:41,690 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:41,731 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:41,731 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:41,731 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:41,731 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_1185596558 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:41,732 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:41,733 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:41,733 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:41,733 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_-1087900185 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:41,989 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:41,990 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000000_0 not found in cache
2013-10-31 18:45:41,990 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331541990
2013-10-31 18:45:42,492 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5370586274571019240_1376 file build/test/data/dfs/data/data8/current/blk_5370586274571019240 for deletion
2013-10-31 18:45:42,492 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5370586274571019240_1376 at file build/test/data/dfs/data/data8/current/blk_5370586274571019240
2013-10-31 18:45:42,568 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_-1272420910 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:42,578 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6840 with signal TERM. Exit code 0
2013-10-31 18:45:42,822 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:42,823 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000001_0 not found in cache
2013-10-31 18:45:42,823 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331542823
2013-10-31 18:45:42,825 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:42,825 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000003_0 not found in cache
2013-10-31 18:45:42,826 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331542826
2013-10-31 18:45:42,995 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000005_0' has completed task_20131031182606197_0038_m_000005 successfully.
2013-10-31 18:45:42,998 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000000_0' to tip task_20131031182606197_0038_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:43,000 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000000
2013-10-31 18:45:43,001 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:45:43,002 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000000_0 which needs 1 slots
2013-10-31 18:45:43,002 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000000_0 which needs 1 slots
2013-10-31 18:45:43,038 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_-1536865775
2013-10-31 18:45:43,039 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_-1536865775 spawned.
2013-10-31 18:45:43,043 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000000_0/taskjvm.sh
2013-10-31 18:45:43,275 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:43,275 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:43,275 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:43,276 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_-1272420910 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:43,612 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_1256737587 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:43,613 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_-116763129 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:43,618 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6963 with signal TERM. Exit code 0
2013-10-31 18:45:43,618 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6974 with signal TERM. Exit code 0
2013-10-31 18:45:43,794 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:43,794 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:43,794 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:43,794 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:43,794 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:43,794 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:45:43,795 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_1256737587 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:43,795 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_-116763129 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:43,827 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000001_0' to tip task_20131031182606197_0038_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:45:43,828 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000001
2013-10-31 18:45:43,829 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:45:43,829 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000001_0 which needs 1 slots
2013-10-31 18:45:43,829 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000001_0 which needs 1 slots
2013-10-31 18:45:43,829 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000002_0' to tip task_20131031182606197_0038_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:45:43,829 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000002
2013-10-31 18:45:43,830 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:45:43,830 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000002_0 which needs 1 slots
2013-10-31 18:45:43,831 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000002_0 which needs 1 slots
2013-10-31 18:45:43,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken	dst=null	perm=null
2013-10-31 18:45:43,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken	dst=null	perm=null
2013-10-31 18:45:43,833 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49251, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1757874773394060354_1388, duration: 136502
2013-10-31 18:45:43,834 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51881, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1757874773394060354_1388, duration: 149760
2013-10-31 18:45:43,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=null
2013-10-31 18:45:43,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=null
2013-10-31 18:45:43,838 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45081, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-1205205789, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5343639107369864272_1385, duration: 167193
2013-10-31 18:45:43,839 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49256, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-163024132, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 183178
2013-10-31 18:45:43,853 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:43,853 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:43,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=null
2013-10-31 18:45:43,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=null
2013-10-31 18:45:43,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51886, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-163024132, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2859678223868609014_1382, duration: 678736
2013-10-31 18:45:43,869 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51887, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1205205789, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2859678223868609014_1382, duration: 645600
2013-10-31 18:45:43,877 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000003_0' to tip task_20131031182606197_0038_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:43,877 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000003
2013-10-31 18:45:43,878 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:45:43,878 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000003_0 which needs 1 slots
2013-10-31 18:45:43,878 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000003_0 which needs 1 slots
2013-10-31 18:45:43,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken	dst=null	perm=null
2013-10-31 18:45:43,882 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49259, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1757874773394060354_1388, duration: 135166
2013-10-31 18:45:43,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml	dst=null	perm=null
2013-10-31 18:45:43,886 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45087, bytes: 27503, op: HDFS_READ, cliID: DFSClient_333977631, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5343639107369864272_1385, duration: 154969
2013-10-31 18:45:43,908 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:43,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar	dst=null	perm=null
2013-10-31 18:45:43,925 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51892, bytes: 239915, op: HDFS_READ, cliID: DFSClient_333977631, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2859678223868609014_1382, duration: 859871
2013-10-31 18:45:43,932 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_2065125206
2013-10-31 18:45:43,932 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_2065125206 spawned.
2013-10-31 18:45:43,933 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000001_0/taskjvm.sh
2013-10-31 18:45:43,941 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_106058079
2013-10-31 18:45:43,942 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_106058079 spawned.
2013-10-31 18:45:43,943 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000002_0/taskjvm.sh
2013-10-31 18:45:44,074 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_-1536865775 given task: attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:44,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=null
2013-10-31 18:45:44,584 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48982, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7884357659738796485_1383, duration: 162459
2013-10-31 18:45:44,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:44,623 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49266, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 307496
2013-10-31 18:45:46,823 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_1344289597
2013-10-31 18:45:46,824 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_1344289597 spawned.
2013-10-31 18:45:46,826 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000003_0/taskjvm.sh
2013-10-31 18:45:47,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:47,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:47,406 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000. blk_110430402879847484_1389
2013-10-31 18:45:47,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_110430402879847484_1389 src: /127.0.0.1:49268 dest: /127.0.0.1:54365
2013-10-31 18:45:47,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_110430402879847484_1389 src: /127.0.0.1:51898 dest: /127.0.0.1:34578
2013-10-31 18:45:47,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_110430402879847484_1389 src: /127.0.0.1:48987 dest: /127.0.0.1:37740
2013-10-31 18:45:47,452 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48987, dest: /127.0.0.1:37740, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_110430402879847484_1389, duration: 1371199
2013-10-31 18:45:47,452 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_110430402879847484_1389 terminating
2013-10-31 18:45:47,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51898, dest: /127.0.0.1:34578, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_110430402879847484_1389, duration: 1589200
2013-10-31 18:45:47,453 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_110430402879847484_1389 terminating
2013-10-31 18:45:47,454 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49268, dest: /127.0.0.1:54365, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_110430402879847484_1389, duration: 2477799
2013-10-31 18:45:47,455 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_110430402879847484_1389 terminating
2013-10-31 18:45:47,458 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_110430402879847484_1389 size 181
2013-10-31 18:45:47,458 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:47,459 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:47,459 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_110430402879847484_1389 size 181
2013-10-31 18:45:47,460 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_110430402879847484_1389 size 181
2013-10-31 18:45:47,522 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:47,522 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000000_0 0.0% 
2013-10-31 18:45:48,002 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0038_m_000005_0
2013-10-31 18:45:48,002 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0038_m_000005_0
2013-10-31 18:45:48,002 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000005_0 not found in cache
2013-10-31 18:45:48,564 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_2065125206 given task: attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:48,714 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_106058079 given task: attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:48,720 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_1344289597 given task: attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:49,006 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:49,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=null
2013-10-31 18:45:49,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48992, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7884357659738796485_1383, duration: 161310
2013-10-31 18:45:49,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:49,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=null
2013-10-31 18:45:49,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split	dst=null	perm=null
2013-10-31 18:45:49,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45104, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7884357659738796485_1383, duration: 129031
2013-10-31 18:45:49,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49279, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7884357659738796485_1383, duration: 177692
2013-10-31 18:45:49,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:49,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:45:49,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51909, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 175400
2013-10-31 18:45:49,249 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48998, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 163092
2013-10-31 18:45:49,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,294 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49282, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 176765
2013-10-31 18:45:49,298 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001. blk_-9113595780919189392_1392
2013-10-31 18:45:49,322 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9113595780919189392_1392 src: /127.0.0.1:49000 dest: /127.0.0.1:37740
2013-10-31 18:45:49,323 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9113595780919189392_1392 src: /127.0.0.1:49284 dest: /127.0.0.1:54365
2013-10-31 18:45:49,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9113595780919189392_1392 src: /127.0.0.1:51914 dest: /127.0.0.1:34578
2013-10-31 18:45:49,326 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51914, dest: /127.0.0.1:34578, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9113595780919189392_1392, duration: 1111857
2013-10-31 18:45:49,326 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9113595780919189392_1392 terminating
2013-10-31 18:45:49,326 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49284, dest: /127.0.0.1:54365, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9113595780919189392_1392, duration: 1513577
2013-10-31 18:45:49,327 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9113595780919189392_1392 terminating
2013-10-31 18:45:49,327 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9113595780919189392_1392 size 134
2013-10-31 18:45:49,327 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49000, dest: /127.0.0.1:37740, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9113595780919189392_1392, duration: 2016916
2013-10-31 18:45:49,327 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9113595780919189392_1392 terminating
2013-10-31 18:45:49,328 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:49,328 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:49,330 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9113595780919189392_1392 size 134
2013-10-31 18:45:49,331 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9113595780919189392_1392 size 134
2013-10-31 18:45:49,428 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003. blk_3848946410901273249_1392
2013-10-31 18:45:49,431 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:49,431 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:49,452 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3848946410901273249_1392 src: /127.0.0.1:45112 dest: /127.0.0.1:59471
2013-10-31 18:45:49,453 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3848946410901273249_1392 src: /127.0.0.1:49287 dest: /127.0.0.1:54365
2013-10-31 18:45:49,453 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3848946410901273249_1392 src: /127.0.0.1:51917 dest: /127.0.0.1:34578
2013-10-31 18:45:49,455 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51917, dest: /127.0.0.1:34578, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3848946410901273249_1392, duration: 1334361
2013-10-31 18:45:49,455 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3848946410901273249_1392 terminating
2013-10-31 18:45:49,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49287, dest: /127.0.0.1:54365, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3848946410901273249_1392, duration: 1498219
2013-10-31 18:45:49,456 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3848946410901273249_1392 terminating
2013-10-31 18:45:49,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45112, dest: /127.0.0.1:59471, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3848946410901273249_1392, duration: 1906836
2013-10-31 18:45:49,456 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3848946410901273249_1392 size 180
2013-10-31 18:45:49,456 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3848946410901273249_1392 terminating
2013-10-31 18:45:49,457 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:49,457 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:49,460 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3848946410901273249_1392 size 180
2013-10-31 18:45:49,460 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3848946410901273249_1392 size 180
2013-10-31 18:45:49,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0	dst=null	perm=null
2013-10-31 18:45:49,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0	dst=null	perm=null
2013-10-31 18:45:49,705 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:49,705 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000003_0 0.0% 
2013-10-31 18:45:49,706 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:49,706 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000001_0 0.0% 
2013-10-31 18:45:49,707 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:49,707 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000002_0 0.0% 
2013-10-31 18:45:49,833 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:49,837 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:49,885 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:50,560 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:45:50,563 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:45:50,564 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000000_0 is done.
2013-10-31 18:45:50,564 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000000_0  was -1
2013-10-31 18:45:50,564 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:50,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0	dst=null	perm=null
2013-10-31 18:45:50,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0	dst=null	perm=null
2013-10-31 18:45:50,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:50,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:50,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0	dst=null	perm=null
2013-10-31 18:45:50,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:50,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:50,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:50,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:50,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0	dst=null	perm=null
2013-10-31 18:45:50,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0	dst=null	perm=null
2013-10-31 18:45:50,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0	dst=null	perm=null
2013-10-31 18:45:52,002 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:45:52,004 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000001_0 is done.
2013-10-31 18:45:52,004 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000001_0  was -1
2013-10-31 18:45:52,005 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:52,010 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000000_0' has completed task_20131031182606197_0038_m_000000 successfully.
2013-10-31 18:45:52,134 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:45:52,134 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:45:52,134 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000003_0 is done.
2013-10-31 18:45:52,134 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000003_0  was -1
2013-10-31 18:45:52,135 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:52,135 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000002_0 is done.
2013-10-31 18:45:52,135 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000002_0  was -1
2013-10-31 18:45:52,135 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:52,836 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000001_0' has completed task_20131031182606197_0038_m_000001 successfully.
2013-10-31 18:45:52,841 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000002_0' has completed task_20131031182606197_0038_m_000002 successfully.
2013-10-31 18:45:52,889 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000003_0' has completed task_20131031182606197_0038_m_000003 successfully.
2013-10-31 18:45:52,892 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0038_m_000004_0' to tip task_20131031182606197_0038_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:52,894 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:45:52,894 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000004_0 which needs 1 slots
2013-10-31 18:45:52,895 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000004_0 which needs 1 slots
2013-10-31 18:45:52,924 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_963364654
2013-10-31 18:45:52,925 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_963364654 spawned.
2013-10-31 18:45:52,926 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000004_0/taskjvm.sh
2013-10-31 18:45:53,839 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_963364654 given task: attempt_20131031182606197_0038_m_000004_0
2013-10-31 18:45:54,352 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000004_0 0.0% 
2013-10-31 18:45:54,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary	dst=null	perm=null
2013-10-31 18:45:54,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:54,372 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_SUCCESS from client DFSClient_attempt_20131031182606197_0038_m_000004_0
2013-10-31 18:45:54,372 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0038_m_000004_0
2013-10-31 18:45:54,377 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:54,378 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,378 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,378 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:54,378 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:54,378 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,379 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:54,379 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,379 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4117612380754601010 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,379 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4117612380754601010 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,379 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4117612380754601010 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:54,379 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5343639107369864272 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,380 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5343639107369864272 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:54,380 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5343639107369864272 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038	dst=null	perm=null
2013-10-31 18:45:55,601 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_-4117612380754601010_1384
2013-10-31 18:45:55,601 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_5343639107369864272_1385 blk_-4117612380754601010_1384
2013-10-31 18:45:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:45:56,018 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,023 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,028 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,034 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,039 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,044 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,044 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 18:45:57,282 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000004_0 0.0% cleanup
2013-10-31 18:45:57,283 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000004_0 is done.
2013-10-31 18:45:57,284 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000004_0  was -1
2013-10-31 18:45:57,284 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:57,424 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4117612380754601010_1384 file build/test/data/dfs/data/data2/current/blk_-4117612380754601010 for deletion
2013-10-31 18:45:57,424 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data1/current/blk_-2859678223868609014 for deletion
2013-10-31 18:45:57,424 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4117612380754601010_1384 at file build/test/data/dfs/data/data2/current/blk_-4117612380754601010
2013-10-31 18:45:57,424 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data1/current/blk_7884357659738796485 for deletion
2013-10-31 18:45:57,425 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data1/current/blk_-2859678223868609014
2013-10-31 18:45:57,425 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data1/current/blk_7884357659738796485
2013-10-31 18:45:57,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4117612380754601010_1384 file build/test/data/dfs/data/data7/current/blk_-4117612380754601010 for deletion
2013-10-31 18:45:57,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data7/current/blk_-2859678223868609014 for deletion
2013-10-31 18:45:57,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4117612380754601010_1384 at file build/test/data/dfs/data/data7/current/blk_-4117612380754601010
2013-10-31 18:45:57,497 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5343639107369864272_1385 file build/test/data/dfs/data/data8/current/blk_5343639107369864272 for deletion
2013-10-31 18:45:57,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data7/current/blk_-2859678223868609014
2013-10-31 18:45:57,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5343639107369864272_1385 at file build/test/data/dfs/data/data8/current/blk_5343639107369864272
2013-10-31 18:45:57,498 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data8/current/blk_7884357659738796485 for deletion
2013-10-31 18:45:57,499 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data8/current/blk_7884357659738796485
2013-10-31 18:45:58,602 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_5343639107369864272_1385 blk_-4117612380754601010_1384
2013-10-31 18:45:58,602 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_5343639107369864272_1385
2013-10-31 18:45:58,902 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000004_0' has completed task_20131031182606197_0038_m_000004 successfully.
2013-10-31 18:45:58,903 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0038 has completed successfully.
2013-10-31 18:45:58,903 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0038,submitTime=1383245135562,launchTime=1383245136193,firstMapTaskLaunchTime=1383245142998,firstJobSetupTaskLaunchTime=1383245136981,firstJobCleanupTaskLaunchTime=1383245152891,finishTime=1383245158903,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[A1E0C7E2D50043E7A70CE6FEC20990D1/5AAB0AA1743442EC8518B72A4DC74B9A] test/(1/1) ...eldedpipesplatform/filter
2013-10-31 18:45:58,908 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC. blk_-4756814230616005261_1393
2013-10-31 18:45:58,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4756814230616005261_1393 src: /127.0.0.1:49010 dest: /127.0.0.1:37740
2013-10-31 18:45:58,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4756814230616005261_1393 src: /127.0.0.1:45120 dest: /127.0.0.1:59471
2013-10-31 18:45:58,914 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4756814230616005261_1393 src: /127.0.0.1:51924 dest: /127.0.0.1:34578
2013-10-31 18:45:58,919 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51924, dest: /127.0.0.1:34578, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4756814230616005261_1393, duration: 95129
2013-10-31 18:45:58,919 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4756814230616005261_1393 terminating
2013-10-31 18:45:58,920 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45120, dest: /127.0.0.1:59471, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4756814230616005261_1393, duration: 2866011
2013-10-31 18:45:58,920 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4756814230616005261_1393 terminating
2013-10-31 18:45:58,921 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49010, dest: /127.0.0.1:37740, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4756814230616005261_1393, duration: 3744366
2013-10-31 18:45:58,921 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4756814230616005261_1393 terminating
2013-10-31 18:45:58,921 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4756814230616005261_1393 size 22363
2013-10-31 18:45:58,925 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4756814230616005261_1393 size 22363
2013-10-31 18:45:58,925 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4756814230616005261_1393 size 22363
2013-10-31 18:45:58,926 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC from client DFSClient_-1107235254
2013-10-31 18:45:58,926 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC is closed by DFSClient_-1107235254
2013-10-31 18:45:58,933 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:58,934 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000003_0'
2013-10-31 18:45:58,934 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000004_0'
2013-10-31 18:45:58,936 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1757874773394060354 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:58,936 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1757874773394060354 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:58,936 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1757874773394060354 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:58,941 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0038_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:58,942 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary
2013-10-31 18:45:58,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038	dst=null	perm=null
2013-10-31 18:45:58,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter	dst=null	perm=null
2013-10-31 18:45:59,000 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:59,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000	dst=null	perm=null
2013-10-31 18:45:59,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001	dst=null	perm=null
2013-10-31 18:45:59,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002	dst=null	perm=null
2013-10-31 18:45:59,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003	dst=null	perm=null
2013-10-31 18:45:59,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000	dst=null	perm=null
2013-10-31 18:45:59,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49297, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_110430402879847484_1389, duration: 280147
2013-10-31 18:45:59,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001	dst=null	perm=null
2013-10-31 18:45:59,012 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49015, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9113595780919189392_1392, duration: 261782
2013-10-31 18:45:59,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002	dst=null	perm=null
2013-10-31 18:45:59,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003	dst=null	perm=null
2013-10-31 18:45:59,017 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49299, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3848946410901273249_1392, duration: 254037
2013-10-31 18:45:59,017 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/filter
2013-10-31 18:45:59,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter	dst=null	perm=null
2013-10-31 18:45:59,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000	dst=null	perm=null
2013-10-31 18:45:59,025 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49300, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_110430402879847484_1389, duration: 253223
2013-10-31 18:45:59,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001	dst=null	perm=null
2013-10-31 18:45:59,029 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49301, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9113595780919189392_1392, duration: 254569
2013-10-31 18:45:59,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002	dst=null	perm=null
2013-10-31 18:45:59,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003	dst=null	perm=null
2013-10-31 18:45:59,036 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51931, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3848946410901273249_1392, duration: 253479
2013-10-31 18:45:59,056 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:45:59,057 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:45:59,068 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] starting
2013-10-31 18:45:59,069 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [concat]  source: MultiSourceTap[2:[Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"], Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]]]
2013-10-31 18:45:59,069 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [concat]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat"]
2013-10-31 18:45:59,069 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [concat]  parallel execution is enabled: true
2013-10-31 18:45:59,070 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [concat]  starting jobs: 1
2013-10-31 18:45:59,070 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [concat]  allocating threads: 1
2013-10-31 18:45:59,071 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [concat] starting step: (1/1) ...pesplatform/complexconcat
2013-10-31 18:45:59,074 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:45:59,074 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:45:59,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:59,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:45:59,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,241 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar. blk_-1986585353932177665_1394
2013-10-31 18:45:59,243 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:51932 dest: /127.0.0.1:34578
2013-10-31 18:45:59,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:45130 dest: /127.0.0.1:59471
2013-10-31 18:45:59,246 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:49022 dest: /127.0.0.1:37740
2013-10-31 18:45:59,254 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49022, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1986585353932177665_1394, duration: 3956099
2013-10-31 18:45:59,254 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1986585353932177665_1394 terminating
2013-10-31 18:45:59,255 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:45:59,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45130, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1986585353932177665_1394, duration: 5218053
2013-10-31 18:45:59,255 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:45:59,255 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1986585353932177665_1394 terminating
2013-10-31 18:45:59,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51932, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1986585353932177665_1394, duration: 5952189
2013-10-31 18:45:59,256 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1986585353932177665_1394 terminating
2013-10-31 18:45:59,258 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar from client DFSClient_-1596270109
2013-10-31 18:45:59,259 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:45:59,260 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:45:59,268 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar. New replication is 10
2013-10-31 18:45:59,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar	dst=null	perm=null
2013-10-31 18:45:59,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,283 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:45:59,288 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 2
2013-10-31 18:45:59,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:45:59,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:45:59,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,299 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4117612380754601010_1384 file build/test/data/dfs/data/data3/current/blk_-4117612380754601010 for deletion
2013-10-31 18:45:59,299 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data3/current/blk_-2859678223868609014 for deletion
2013-10-31 18:45:59,300 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4117612380754601010_1384 at file build/test/data/dfs/data/data3/current/blk_-4117612380754601010
2013-10-31 18:45:59,300 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5343639107369864272_1385 file build/test/data/dfs/data/data4/current/blk_5343639107369864272 for deletion
2013-10-31 18:45:59,301 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data3/current/blk_-2859678223868609014
2013-10-31 18:45:59,301 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5343639107369864272_1385 at file build/test/data/dfs/data/data4/current/blk_5343639107369864272
2013-10-31 18:45:59,301 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data4/current/blk_7884357659738796485 for deletion
2013-10-31 18:45:59,302 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data4/current/blk_7884357659738796485
2013-10-31 18:45:59,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,306 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split. New replication is 10
2013-10-31 18:45:59,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:45:59,314 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split. blk_1166790603136202975_1395
2013-10-31 18:45:59,316 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:51935 dest: /127.0.0.1:34578
2013-10-31 18:45:59,317 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:49024 dest: /127.0.0.1:37740
2013-10-31 18:45:59,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:45134 dest: /127.0.0.1:59471
2013-10-31 18:45:59,320 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:49309 dest: /127.0.0.1:54365
2013-10-31 18:45:59,324 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49309, dest: /127.0.0.1:54365, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1166790603136202975_1395, duration: 115704
2013-10-31 18:45:59,324 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,325 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45134, dest: /127.0.0.1:59471, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 967846
2013-10-31 18:45:59,325 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,326 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49024, dest: /127.0.0.1:37740, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1166790603136202975_1395, duration: 2024220
2013-10-31 18:45:59,326 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,327 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,327 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51935, dest: /127.0.0.1:34578, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1166790603136202975_1395, duration: 2957022
2013-10-31 18:45:59,327 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,328 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,330 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,331 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split from client DFSClient_-1596270109
2013-10-31 18:45:59,331 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split is closed by DFSClient_-1596270109
2013-10-31 18:45:59,332 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,347 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo. blk_5434570261073731497_1396
2013-10-31 18:45:59,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5434570261073731497_1396 src: /127.0.0.1:45136 dest: /127.0.0.1:59471
2013-10-31 18:45:59,350 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5434570261073731497_1396 src: /127.0.0.1:51940 dest: /127.0.0.1:34578
2013-10-31 18:45:59,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5434570261073731497_1396 src: /127.0.0.1:49312 dest: /127.0.0.1:54365
2013-10-31 18:45:59,368 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49312, dest: /127.0.0.1:54365, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5434570261073731497_1396, duration: 759808
2013-10-31 18:45:59,369 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5434570261073731497_1396 terminating
2013-10-31 18:45:59,370 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51940, dest: /127.0.0.1:34578, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5434570261073731497_1396, duration: 2841634
2013-10-31 18:45:59,374 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5434570261073731497_1396 terminating
2013-10-31 18:45:59,374 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45136, dest: /127.0.0.1:59471, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5434570261073731497_1396, duration: 6655673
2013-10-31 18:45:59,374 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5434570261073731497_1396 size 218
2013-10-31 18:45:59,375 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5434570261073731497_1396 terminating
2013-10-31 18:45:59,376 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5434570261073731497_1396 size 218
2013-10-31 18:45:59,377 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:45:59,377 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:45:59,378 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5434570261073731497_1396 size 218
2013-10-31 18:45:59,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,401 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml. blk_7343258894093907583_1397
2013-10-31 18:45:59,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7343258894093907583_1397 src: /127.0.0.1:49030 dest: /127.0.0.1:37740
2013-10-31 18:45:59,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7343258894093907583_1397 src: /127.0.0.1:51943 dest: /127.0.0.1:34578
2013-10-31 18:45:59,406 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7343258894093907583_1397 src: /127.0.0.1:45141 dest: /127.0.0.1:59471
2013-10-31 18:45:59,409 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45141, dest: /127.0.0.1:59471, bytes: 28208, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7343258894093907583_1397, duration: 285912
2013-10-31 18:45:59,410 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7343258894093907583_1397 terminating
2013-10-31 18:45:59,410 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51943, dest: /127.0.0.1:34578, bytes: 28208, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7343258894093907583_1397, duration: 1147468
2013-10-31 18:45:59,410 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7343258894093907583_1397 terminating
2013-10-31 18:45:59,411 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49030, dest: /127.0.0.1:37740, bytes: 28208, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 2108270
2013-10-31 18:45:59,411 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7343258894093907583_1397 size 28208
2013-10-31 18:45:59,411 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7343258894093907583_1397 terminating
2013-10-31 18:45:59,416 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7343258894093907583_1397 size 28208
2013-10-31 18:45:59,416 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml from client DFSClient_-1596270109
2013-10-31 18:45:59,417 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:45:59,417 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7343258894093907583_1397 size 28208
2013-10-31 18:45:59,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml	dst=null	perm=null
2013-10-31 18:45:59,431 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49034, bytes: 28432, op: HDFS_READ, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 390593
2013-10-31 18:45:59,450 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0039: nMaps=6 nReduces=1 max=-1
2013-10-31 18:45:59,450 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0039 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:45:59,450 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0039
2013-10-31 18:45:59,450 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0039	RESULT=SUCCESS
2013-10-31 18:45:59,451 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0039
2013-10-31 18:45:59,452 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [concat] submitted hadoop job: job_20131031182606197_0039
2013-10-31 18:45:59,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,484 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml. blk_-2129735822278363250_1399
2013-10-31 18:45:59,486 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2129735822278363250_1399 src: /127.0.0.1:51947 dest: /127.0.0.1:34578
2013-10-31 18:45:59,487 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2129735822278363250_1399 src: /127.0.0.1:45145 dest: /127.0.0.1:59471
2013-10-31 18:45:59,489 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2129735822278363250_1399 src: /127.0.0.1:49320 dest: /127.0.0.1:54365
2013-10-31 18:45:59,493 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49320, dest: /127.0.0.1:54365, bytes: 28273, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2129735822278363250_1399, duration: 667990
2013-10-31 18:45:59,493 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2129735822278363250_1399 terminating
2013-10-31 18:45:59,494 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45145, dest: /127.0.0.1:59471, bytes: 28273, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2129735822278363250_1399, duration: 1474047
2013-10-31 18:45:59,494 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2129735822278363250_1399 terminating
2013-10-31 18:45:59,495 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51947, dest: /127.0.0.1:34578, bytes: 28273, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2129735822278363250_1399, duration: 2508767
2013-10-31 18:45:59,495 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2129735822278363250_1399 terminating
2013-10-31 18:45:59,498 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2129735822278363250_1399 size 28273
2013-10-31 18:45:59,498 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml from client DFSClient_-1631050623
2013-10-31 18:45:59,499 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml is closed by DFSClient_-1631050623
2013-10-31 18:45:59,499 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2129735822278363250_1399 size 28273
2013-10-31 18:45:59,500 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2129735822278363250_1399 size 28273
2013-10-31 18:45:59,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,781 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken. blk_4955026965077948598_1400
2013-10-31 18:45:59,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4955026965077948598_1400 src: /127.0.0.1:49038 dest: /127.0.0.1:37740
2013-10-31 18:45:59,784 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4955026965077948598_1400 src: /127.0.0.1:45148 dest: /127.0.0.1:59471
2013-10-31 18:45:59,786 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4955026965077948598_1400 src: /127.0.0.1:49323 dest: /127.0.0.1:54365
2013-10-31 18:45:59,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49323, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4955026965077948598_1400, duration: 596903
2013-10-31 18:45:59,789 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4955026965077948598_1400 terminating
2013-10-31 18:45:59,790 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45148, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4955026965077948598_1400, duration: 1366568
2013-10-31 18:45:59,790 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4955026965077948598_1400 terminating
2013-10-31 18:45:59,790 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4955026965077948598_1400 size 116
2013-10-31 18:45:59,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49038, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4955026965077948598_1400, duration: 2252022
2013-10-31 18:45:59,791 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4955026965077948598_1400 terminating
2013-10-31 18:45:59,793 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4955026965077948598_1400 size 116
2013-10-31 18:45:59,794 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken from client DFSClient_-1596270109
2013-10-31 18:45:59,794 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:45:59,795 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4955026965077948598_1400 size 116
2013-10-31 18:45:59,800 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken
2013-10-31 18:45:59,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:45:59,804 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49324, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5434570261073731497_1396, duration: 266116
2013-10-31 18:45:59,806 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0039 = 38. Number of splits = 6
2013-10-31 18:45:59,806 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,806 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,811 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0039 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:45:59,811 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0039 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:46:00,028 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data5/current/blk_-2859678223868609014 for deletion
2013-10-31 18:46:00,028 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5343639107369864272_1385 file build/test/data/dfs/data/data5/current/blk_5343639107369864272 for deletion
2013-10-31 18:46:00,028 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data5/current/blk_-2859678223868609014
2013-10-31 18:46:00,028 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data6/current/blk_7884357659738796485 for deletion
2013-10-31 18:46:00,029 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5343639107369864272_1385 at file build/test/data/dfs/data/data5/current/blk_5343639107369864272
2013-10-31 18:46:00,029 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data6/current/blk_7884357659738796485
2013-10-31 18:46:01,024 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0039_m_000007_0' to tip task_20131031182606197_0039_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:01,032 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000000_0'
2013-10-31 18:46:01,033 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000005_0'
2013-10-31 18:46:01,034 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:46:01,035 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000007_0 which needs 1 slots
2013-10-31 18:46:01,035 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000007_0 which needs 1 slots
2013-10-31 18:46:01,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken	dst=null	perm=null
2013-10-31 18:46:01,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49042, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4955026965077948598_1400, duration: 300794
2013-10-31 18:46:01,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml	dst=null	perm=null
2013-10-31 18:46:01,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49044, bytes: 28432, op: HDFS_READ, cliID: DFSClient_-400017871, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 376435
2013-10-31 18:46:01,087 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:01,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar	dst=null	perm=null
2013-10-31 18:46:01,110 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45154, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-400017871, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1986585353932177665_1394, duration: 600067
2013-10-31 18:46:01,167 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0038_m_-609775213
2013-10-31 18:46:01,173 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7370 with signal TERM. Exit code 0
2013-10-31 18:46:01,173 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:01,174 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_902584542 spawned.
2013-10-31 18:46:01,175 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000007_0/taskjvm.sh
2013-10-31 18:46:01,404 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:01,404 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:01,404 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:01,404 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_-609775213 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:01,603 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-1986585353932177665_1394 to datanode(s) 127.0.0.1:54365
2013-10-31 18:46:01,603 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-1757874773394060354_1388
2013-10-31 18:46:01,603 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-1757874773394060354_1388
2013-10-31 18:46:01,847 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000001_0'
2013-10-31 18:46:01,851 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000002_0'
2013-10-31 18:46:02,104 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_902584542 given task: attempt_20131031182606197_0039_m_000007_0
2013-10-31 18:46:02,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:03,029 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1757874773394060354_1388 file build/test/data/dfs/data/data5/current/blk_-1757874773394060354 for deletion
2013-10-31 18:46:03,029 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1757874773394060354_1388 at file build/test/data/dfs/data/data5/current/blk_-1757874773394060354
2013-10-31 18:46:03,426 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-1986585353932177665_1394 to 127.0.0.1:54365 
2013-10-31 18:46:03,426 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1757874773394060354_1388 file build/test/data/dfs/data/data2/current/blk_-1757874773394060354 for deletion
2013-10-31 18:46:03,427 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1757874773394060354_1388 at file build/test/data/dfs/data/data2/current/blk_-1757874773394060354
2013-10-31 18:46:03,428 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:49331 dest: /127.0.0.1:54365
2013-10-31 18:46:03,428 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-1986585353932177665_1394 to /127.0.0.1:54365
2013-10-31 18:46:03,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1986585353932177665_1394 src: /127.0.0.1:49331 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:46:03,436 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:46:03,936 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:03,936 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000004_0 not found in cache
2013-10-31 18:46:03,937 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000003_0 not found in cache
2013-10-31 18:46:03,937 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331563937
2013-10-31 18:46:04,604 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_-1757874773394060354_1388
2013-10-31 18:46:04,685 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_1344289597 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:04,696 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7663 with signal TERM. Exit code 0
2013-10-31 18:46:04,893 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:04,894 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:04,894 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:04,894 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_1344289597 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:05,301 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1757874773394060354_1388 file build/test/data/dfs/data/data3/current/blk_-1757874773394060354 for deletion
2013-10-31 18:46:05,301 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1757874773394060354_1388 at file build/test/data/dfs/data/data3/current/blk_-1757874773394060354
2013-10-31 18:46:05,353 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_963364654 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:05,362 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7833 with signal TERM. Exit code 0
2013-10-31 18:46:05,540 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:05,540 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:05,540 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:05,540 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_963364654 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:05,552 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000007_0 0.0% setup
2013-10-31 18:46:05,555 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000007_0 is done.
2013-10-31 18:46:05,555 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000007_0  was -1
2013-10-31 18:46:05,555 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:06,035 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:06,036 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000000_0 not found in cache
2013-10-31 18:46:06,036 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331566036
2013-10-31 18:46:06,108 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_-1536865775 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:06,118 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7477 with signal TERM. Exit code 0
2013-10-31 18:46:06,316 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:06,317 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:06,317 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:06,317 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_-1536865775 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:06,848 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:06,848 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000001_0 not found in cache
2013-10-31 18:46:06,848 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331566848
2013-10-31 18:46:06,851 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:06,852 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000002_0 not found in cache
2013-10-31 18:46:06,852 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331566852
2013-10-31 18:46:07,041 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000007_0' has completed task_20131031182606197_0039_m_000007 successfully.
2013-10-31 18:46:07,045 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000000_0' to tip task_20131031182606197_0039_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:07,046 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000000
2013-10-31 18:46:07,047 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000001_0' to tip task_20131031182606197_0039_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:07,047 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000001
2013-10-31 18:46:07,049 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:07,050 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:46:07,050 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000000_0 which needs 1 slots
2013-10-31 18:46:07,050 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000000_0 which needs 1 slots
2013-10-31 18:46:07,051 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000001_0 which needs 1 slots
2013-10-31 18:46:07,051 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0039_m_000001_0 which needs 1 slots
2013-10-31 18:46:07,084 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_1010047912
2013-10-31 18:46:07,085 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_1010047912 spawned.
2013-10-31 18:46:07,086 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0039/attempt_20131031182606197_0039_m_000000_0. Attempting to reuse: jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:07,089 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000001_0/taskjvm.sh
2013-10-31 18:46:07,110 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_902584542 given task: attempt_20131031182606197_0039_m_000000_0
2013-10-31 18:46:07,135 INFO  mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031182606197_0039_m_000000_0 is 88 ms debug.
2013-10-31 18:46:07,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:46:07,266 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49333, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1166790603136202975_1395, duration: 165557
2013-10-31 18:46:07,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:46:07,574 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49334, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 130524
2013-10-31 18:46:07,576 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_2065125206 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:07,581 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7628 with signal TERM. Exit code 0
2013-10-31 18:46:07,686 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_106058079 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:07,691 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7664 with signal TERM. Exit code 0
2013-10-31 18:46:07,739 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:07,739 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:07,739 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:07,739 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_2065125206 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:07,853 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000002_0' to tip task_20131031182606197_0039_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:46:07,854 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000002
2013-10-31 18:46:07,854 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000003_0' to tip task_20131031182606197_0039_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:46:07,854 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000003
2013-10-31 18:46:07,855 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:46:07,855 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:46:07,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000002_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000002_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000003_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0039_m_000003_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000004_0' to tip task_20131031182606197_0039_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:46:07,857 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000004
2013-10-31 18:46:07,857 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000005_0' to tip task_20131031182606197_0039_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:46:07,857 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000005
2013-10-31 18:46:07,858 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:46:07,859 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:46:07,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000004_0 which needs 1 slots
2013-10-31 18:46:07,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken	dst=null	perm=null
2013-10-31 18:46:07,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000004_0 which needs 1 slots
2013-10-31 18:46:07,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000005_0 which needs 1 slots
2013-10-31 18:46:07,859 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0039_m_000005_0 which needs 1 slots
2013-10-31 18:46:07,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45162, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4955026965077948598_1400, duration: 182201
2013-10-31 18:46:07,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken	dst=null	perm=null
2013-10-31 18:46:07,863 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45164, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4955026965077948598_1400, duration: 126943
2013-10-31 18:46:07,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml	dst=null	perm=null
2013-10-31 18:46:07,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml	dst=null	perm=null
2013-10-31 18:46:07,866 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51969, bytes: 28432, op: HDFS_READ, cliID: DFSClient_1085241453, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7343258894093907583_1397, duration: 154454
2013-10-31 18:46:07,867 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49058, bytes: 28432, op: HDFS_READ, cliID: DFSClient_1917658636, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 165504
2013-10-31 18:46:07,879 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:07,879 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:07,881 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:07,881 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:07,881 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:07,881 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_106058079 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:07,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar	dst=null	perm=null
2013-10-31 18:46:07,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar	dst=null	perm=null
2013-10-31 18:46:07,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51972, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1917658636, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1986585353932177665_1394, duration: 731867
2013-10-31 18:46:07,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45168, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1085241453, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1986585353932177665_1394, duration: 710125
2013-10-31 18:46:07,954 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_1010047912 given task: attempt_20131031182606197_0039_m_000001_0
2013-10-31 18:46:07,963 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_1519844982
2013-10-31 18:46:07,964 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_1519844982 spawned.
2013-10-31 18:46:07,964 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_-204099648
2013-10-31 18:46:07,964 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_-387027469
2013-10-31 18:46:07,964 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_-204099648 spawned.
2013-10-31 18:46:07,965 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_-387027469 spawned.
2013-10-31 18:46:07,966 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_-1608983854
2013-10-31 18:46:07,966 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000003_0/taskjvm.sh
2013-10-31 18:46:07,967 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_-1608983854 spawned.
2013-10-31 18:46:07,967 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000002_0/taskjvm.sh
2013-10-31 18:46:07,968 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000004_0/taskjvm.sh
2013-10-31 18:46:07,968 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000005_0/taskjvm.sh
2013-10-31 18:46:09,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:46:09,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45171, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 174407
2013-10-31 18:46:09,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:46:09,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45172, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 135769
2013-10-31 18:46:09,605 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_-387027469 given task: attempt_20131031182606197_0039_m_000002_0
2013-10-31 18:46:09,609 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_-204099648 given task: attempt_20131031182606197_0039_m_000004_0
2013-10-31 18:46:09,610 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_-1608983854 given task: attempt_20131031182606197_0039_m_000005_0
2013-10-31 18:46:09,612 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_1519844982 given task: attempt_20131031182606197_0039_m_000003_0
2013-10-31 18:46:10,116 INFO  security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:46:10,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:46:10,123 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45181, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000005_0, offset: 1536, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 157856
2013-10-31 18:46:10,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:46:10,138 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49356, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1166790603136202975_1395, duration: 144528
2013-10-31 18:46:10,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:46:10,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split	dst=null	perm=null
2013-10-31 18:46:10,147 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45183, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000004_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 268355
2013-10-31 18:46:10,152 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49075, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1166790603136202975_1395, duration: 154450
2013-10-31 18:46:10,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:46:10,164 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49076, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000005_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 135176
2013-10-31 18:46:10,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:46:10,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt	dst=null	perm=null
2013-10-31 18:46:10,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt	dst=null	perm=null
2013-10-31 18:46:10,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49077, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000004_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 136404
2013-10-31 18:46:10,192 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49361, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 108093
2013-10-31 18:46:10,217 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:46:10,218 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000000_0 is done.
2013-10-31 18:46:10,218 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000000_0  was 57
2013-10-31 18:46:10,219 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:46:10,428 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49362, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 141527
2013-10-31 18:46:12,050 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0039_m_000007_0
2013-10-31 18:46:12,051 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0039_m_000007_0
2013-10-31 18:46:12,051 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0039_m_000007_0 not found in cache
2013-10-31 18:46:12,069 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:46:12,072 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000001_0 is done.
2013-10-31 18:46:12,072 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000001_0  was 40
2013-10-31 18:46:12,073 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:13,048 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000005_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:46:13,050 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000005_0 is done.
2013-10-31 18:46:13,051 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000005_0  was 6
2013-10-31 18:46:13,051 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:46:13,056 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000000_0' has completed task_20131031182606197_0039_m_000000 successfully.
2013-10-31 18:46:13,057 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000001_0' has completed task_20131031182606197_0039_m_000001 successfully.
2013-10-31 18:46:13,059 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0039_r_000000_0' to tip task_20131031182606197_0039_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:13,061 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:13,061 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:46:13,061 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_r_000000_0 which needs 1 slots
2013-10-31 18:46:13,062 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_r_000000_0 which needs 1 slots
2013-10-31 18:46:13,064 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000002_0 is done.
2013-10-31 18:46:13,066 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000002_0  was 57
2013-10-31 18:46:13,066 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:46:13,067 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:46:13,069 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000004_0 is done.
2013-10-31 18:46:13,069 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000004_0  was 6
2013-10-31 18:46:13,070 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:13,073 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:46:13,076 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000003_0 is done.
2013-10-31 18:46:13,076 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000003_0  was 40
2013-10-31 18:46:13,076 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:13,099 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_r_593026137
2013-10-31 18:46:13,099 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_r_593026137 spawned.
2013-10-31 18:46:13,101 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_r_000000_0/taskjvm.sh
2013-10-31 18:46:13,860 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000002_0' has completed task_20131031182606197_0039_m_000002 successfully.
2013-10-31 18:46:13,861 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000003_0' has completed task_20131031182606197_0039_m_000003 successfully.
2013-10-31 18:46:13,863 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000004_0' has completed task_20131031182606197_0039_m_000004 successfully.
2013-10-31 18:46:13,864 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000005_0' has completed task_20131031182606197_0039_m_000005 successfully.
2013-10-31 18:46:14,105 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_r_593026137 given task: attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:19,785 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:43397, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000000_0, duration: 7078563
2013-10-31 18:46:19,796 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:43397, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000001_0, duration: 5081805
2013-10-31 18:46:19,808 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41377, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000002_0, duration: 9398972
2013-10-31 18:46:19,819 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41377, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000003_0, duration: 7640272
2013-10-31 18:46:19,835 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:46075, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000004_0, duration: 12364902
2013-10-31 18:46:19,851 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:46075, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000005_0, duration: 11619097
2013-10-31 18:46:20,588 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:20,634 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:20,691 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:20,878 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2097 Total time for transactions(ms): 36Number of transactions batched in Syncs: 179 Number of syncs: 1475 SyncTimes(ms): 85716 20273 
2013-10-31 18:46:20,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:20,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:20,909 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000. blk_3582165743761812411_1401
2013-10-31 18:46:20,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3582165743761812411_1401 src: /127.0.0.1:49086 dest: /127.0.0.1:37740
2013-10-31 18:46:20,944 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3582165743761812411_1401 src: /127.0.0.1:45196 dest: /127.0.0.1:59471
2013-10-31 18:46:20,945 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3582165743761812411_1401 src: /127.0.0.1:49371 dest: /127.0.0.1:54365
2013-10-31 18:46:20,947 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49371, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0039_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3582165743761812411_1401, duration: 1004123
2013-10-31 18:46:20,947 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3582165743761812411_1401 terminating
2013-10-31 18:46:20,947 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3582165743761812411_1401 size 40
2013-10-31 18:46:20,947 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45196, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0039_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3582165743761812411_1401, duration: 1385823
2013-10-31 18:46:20,950 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3582165743761812411_1401 terminating
2013-10-31 18:46:20,951 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49086, dest: /127.0.0.1:37740, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0039_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3582165743761812411_1401, duration: 4420078
2013-10-31 18:46:20,951 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3582165743761812411_1401 terminating
2013-10-31 18:46:20,951 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3582165743761812411_1401 size 40
2013-10-31 18:46:20,952 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3582165743761812411_1401 size 40
2013-10-31 18:46:20,953 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:20,954 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:20,990 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0039_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:46:20,990 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:22,072 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   6 OK for attempt_20131031182606197_0039_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:46:22,073 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:23,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0	dst=null	perm=null
2013-10-31 18:46:23,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:23,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:23,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0	dst=null	perm=null
2013-10-31 18:46:23,636 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 1.0% reduce > reduce
2013-10-31 18:46:23,638 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 1.0% reduce > reduce
2013-10-31 18:46:23,639 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_r_000000_0 is done.
2013-10-31 18:46:23,639 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_r_000000_0  was -1
2013-10-31 18:46:23,639 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:24,646 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7295626289958709819_1037
2013-10-31 18:46:25,077 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_r_000000_0' has completed task_20131031182606197_0039_r_000000 successfully.
2013-10-31 18:46:25,080 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0039_m_000006_0' to tip task_20131031182606197_0039_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:25,084 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:46:25,084 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000006_0 which needs 1 slots
2013-10-31 18:46:25,084 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000006_0 which needs 1 slots
2013-10-31 18:46:25,120 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0039/attempt_20131031182606197_0039_m_000006_0. Attempting to reuse: jvm_20131031182606197_0039_m_1010047912
2013-10-31 18:46:26,144 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_1010047912 given task: attempt_20131031182606197_0039_m_000006_0
2013-10-31 18:46:26,273 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000006_0 0.0% 
2013-10-31 18:46:26,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary	dst=null	perm=null
2013-10-31 18:46:26,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:26,291 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_SUCCESS from client DFSClient_attempt_20131031182606197_0039_m_000006_0
2013-10-31 18:46:26,291 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0039_m_000006_0
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:26,296 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,297 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,297 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5434570261073731497 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:26,297 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5434570261073731497 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,297 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5434570261073731497 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,297 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7343258894093907583 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,298 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7343258894093907583 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,298 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7343258894093907583 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:26,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039	dst=null	perm=null
2013-10-31 18:46:28,608 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_5434570261073731497_1396 blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_7343258894093907583_1397
2013-10-31 18:46:28,608 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_7343258894093907583_1397
2013-10-31 18:46:29,228 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000006_0 0.0% cleanup
2013-10-31 18:46:29,230 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000006_0 is done.
2013-10-31 18:46:29,230 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000006_0  was -1
2013-10-31 18:46:29,231 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:30,084 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:30,085 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:30,435 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data2/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:30,435 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data1/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:30,436 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5434570261073731497_1396 file build/test/data/dfs/data/data2/current/blk_5434570261073731497 for deletion
2013-10-31 18:46:30,436 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data1/current/blk_1166790603136202975
2013-10-31 18:46:30,436 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7343258894093907583_1397 file build/test/data/dfs/data/data1/current/blk_7343258894093907583 for deletion
2013-10-31 18:46:30,436 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data2/current/blk_-1986585353932177665
2013-10-31 18:46:30,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7343258894093907583_1397 at file build/test/data/dfs/data/data1/current/blk_7343258894093907583
2013-10-31 18:46:30,437 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5434570261073731497_1396 at file build/test/data/dfs/data/data2/current/blk_5434570261073731497
2013-10-31 18:46:30,508 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data7/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:30,508 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data8/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:30,508 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data7/current/blk_-1986585353932177665
2013-10-31 18:46:30,508 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data8/current/blk_1166790603136202975
2013-10-31 18:46:30,508 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7343258894093907583_1397 file build/test/data/dfs/data/data7/current/blk_7343258894093907583 for deletion
2013-10-31 18:46:30,509 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7343258894093907583_1397 at file build/test/data/dfs/data/data7/current/blk_7343258894093907583
2013-10-31 18:46:31,090 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000006_0' has completed task_20131031182606197_0039_m_000006 successfully.
2013-10-31 18:46:31,091 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0039 has completed successfully.
2013-10-31 18:46:31,092 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0039,submitTime=1383245159422,launchTime=1383245159811,firstMapTaskLaunchTime=1383245167045,firstReduceTaskLaunchTime=1383245173058,firstJobSetupTaskLaunchTime=1383245161024,firstJobCleanupTaskLaunchTime=1383245185079,finishTime=1383245191091,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=37,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5EE10D7CE2734FEA8E342CB39C7F3783/2C74E9795F8D496CAE6232BE71DCB34C] concat/(1/1) ...pesplatform/complexconcat
2013-10-31 18:46:31,096 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C. blk_-2645325153373715552_1402
2013-10-31 18:46:31,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2645325153373715552_1402 src: /127.0.0.1:52003 dest: /127.0.0.1:34578
2013-10-31 18:46:31,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2645325153373715552_1402 src: /127.0.0.1:49375 dest: /127.0.0.1:54365
2013-10-31 18:46:31,106 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2645325153373715552_1402 src: /127.0.0.1:45202 dest: /127.0.0.1:59471
2013-10-31 18:46:31,112 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45202, dest: /127.0.0.1:59471, bytes: 34988, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2645325153373715552_1402, duration: 3616823
2013-10-31 18:46:31,112 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2645325153373715552_1402 terminating
2013-10-31 18:46:31,113 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49375, dest: /127.0.0.1:54365, bytes: 34988, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2645325153373715552_1402, duration: 4408852
2013-10-31 18:46:31,113 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2645325153373715552_1402 terminating
2013-10-31 18:46:31,114 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52003, dest: /127.0.0.1:34578, bytes: 34988, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2645325153373715552_1402, duration: 5260037
2013-10-31 18:46:31,114 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2645325153373715552_1402 size 34988
2013-10-31 18:46:31,114 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2645325153373715552_1402 terminating
2013-10-31 18:46:31,120 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2645325153373715552_1402 size 34988
2013-10-31 18:46:31,121 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C from client DFSClient_-1631050623
2013-10-31 18:46:31,122 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C is closed by DFSClient_-1631050623
2013-10-31 18:46:31,122 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2645325153373715552_1402 size 34988
2013-10-31 18:46:31,128 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:46:31,129 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000000_0'
2013-10-31 18:46:31,129 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000001_0'
2013-10-31 18:46:31,130 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000006_0'
2013-10-31 18:46:31,131 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4955026965077948598 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:31,131 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000007_0'
2013-10-31 18:46:31,131 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4955026965077948598 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:31,131 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_r_000000_0'
2013-10-31 18:46:31,132 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4955026965077948598 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:31,134 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0039_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:46:31,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039	dst=null	perm=null
2013-10-31 18:46:31,138 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary
2013-10-31 18:46:31,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat	dst=null	perm=null
2013-10-31 18:46:31,157 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:46:31,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000	dst=null	perm=null
2013-10-31 18:46:31,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000	dst=null	perm=null
2013-10-31 18:46:31,162 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49095, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3582165743761812411_1401, duration: 2094328
2013-10-31 18:46:31,162 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/complexconcat
2013-10-31 18:46:31,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat	dst=null	perm=null
2013-10-31 18:46:31,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000	dst=null	perm=null
2013-10-31 18:46:31,167 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49379, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3582165743761812411_1401, duration: 334265
2013-10-31 18:46:31,175 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:46:31,175 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:46:31,198 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting
2013-10-31 18:46:31,198 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:46:31,199 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1"]
2013-10-31 18:46:31,199 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2"]
2013-10-31 18:46:31,199 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  parallel execution is enabled: true
2013-10-31 18:46:31,199 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  starting jobs: 3
2013-10-31 18:46:31,200 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right]  allocating threads: 3
2013-10-31 18:46:31,203 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (1/3)
2013-10-31 18:46:31,205 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:46:31,205 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:46:31,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:31,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:46:31,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:31,227 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar. blk_1798187280963192099_1403
2013-10-31 18:46:31,229 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:49097 dest: /127.0.0.1:37740
2013-10-31 18:46:31,230 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:52010 dest: /127.0.0.1:34578
2013-10-31 18:46:31,232 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:45208 dest: /127.0.0.1:59471
2013-10-31 18:46:31,244 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45208, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1798187280963192099_1403, duration: 7293555
2013-10-31 18:46:31,245 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1798187280963192099_1403 terminating
2013-10-31 18:46:31,245 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52010, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1798187280963192099_1403, duration: 8155529
2013-10-31 18:46:31,245 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1798187280963192099_1403 terminating
2013-10-31 18:46:31,246 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49097, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1798187280963192099_1403, duration: 9132833
2013-10-31 18:46:31,246 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1798187280963192099_1403 terminating
2013-10-31 18:46:31,249 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:31,250 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:31,250 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:31,608 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5434570261073731497_1396 blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_4955026965077948598_1400 blk_7343258894093907583_1397
2013-10-31 18:46:31,608 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5434570261073731497_1396 blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_4955026965077948598_1400
2013-10-31 18:46:31,649 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar from client DFSClient_-1596270109
2013-10-31 18:46:31,649 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:46:31,881 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000002_0'
2013-10-31 18:46:31,881 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000003_0'
2013-10-31 18:46:31,884 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000004_0'
2013-10-31 18:46:31,885 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000005_0'
2013-10-31 18:46:31,968 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:31,968 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0039 being deleted.
2013-10-31 18:46:32,310 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data3/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:32,310 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data3/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:32,310 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4955026965077948598_1400 file build/test/data/dfs/data/data4/current/blk_4955026965077948598 for deletion
2013-10-31 18:46:32,310 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data3/current/blk_-1986585353932177665
2013-10-31 18:46:32,311 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5434570261073731497_1396 file build/test/data/dfs/data/data4/current/blk_5434570261073731497 for deletion
2013-10-31 18:46:32,311 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data3/current/blk_1166790603136202975
2013-10-31 18:46:32,311 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4955026965077948598_1400 at file build/test/data/dfs/data/data4/current/blk_4955026965077948598
2013-10-31 18:46:32,312 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5434570261073731497_1396 at file build/test/data/dfs/data/data4/current/blk_5434570261073731497
2013-10-31 18:46:33,039 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data6/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:33,039 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data5/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:33,039 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data6/current/blk_-1986585353932177665
2013-10-31 18:46:33,039 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4955026965077948598_1400 file build/test/data/dfs/data/data5/current/blk_4955026965077948598 for deletion
2013-10-31 18:46:33,039 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data5/current/blk_1166790603136202975
2013-10-31 18:46:33,040 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5434570261073731497_1396 file build/test/data/dfs/data/data6/current/blk_5434570261073731497 for deletion
2013-10-31 18:46:33,040 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4955026965077948598_1400 at file build/test/data/dfs/data/data5/current/blk_4955026965077948598
2013-10-31 18:46:33,040 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5434570261073731497_1396 at file build/test/data/dfs/data/data6/current/blk_5434570261073731497
2013-10-31 18:46:33,040 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7343258894093907583_1397 file build/test/data/dfs/data/data5/current/blk_7343258894093907583 for deletion
2013-10-31 18:46:33,041 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7343258894093907583_1397 at file build/test/data/dfs/data/data5/current/blk_7343258894093907583
2013-10-31 18:46:33,182 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar. New replication is 10
2013-10-31 18:46:33,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=null
2013-10-31 18:46:33,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,195 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:46:33,199 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:46:33,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:46:33,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,215 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split. New replication is 10
2013-10-31 18:46:33,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=null
2013-10-31 18:46:33,224 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split. blk_7967776557441908343_1404
2013-10-31 18:46:33,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:45209 dest: /127.0.0.1:59471
2013-10-31 18:46:33,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:52013 dest: /127.0.0.1:34578
2013-10-31 18:46:33,229 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:49102 dest: /127.0.0.1:37740
2013-10-31 18:46:33,230 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:49386 dest: /127.0.0.1:54365
2013-10-31 18:46:33,234 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49386, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7967776557441908343_1404, duration: 646124
2013-10-31 18:46:33,235 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,235 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49102, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7967776557441908343_1404, duration: 1498478
2013-10-31 18:46:33,236 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,236 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,237 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52013, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7967776557441908343_1404, duration: 3036045
2013-10-31 18:46:33,237 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,237 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45209, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7967776557441908343_1404, duration: 3828460
2013-10-31 18:46:33,238 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,240 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,241 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split from client DFSClient_-1596270109
2013-10-31 18:46:33,241 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split is closed by DFSClient_-1596270109
2013-10-31 18:46:33,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,258 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo. blk_4924507397654323874_1405
2013-10-31 18:46:33,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4924507397654323874_1405 src: /127.0.0.1:45213 dest: /127.0.0.1:59471
2013-10-31 18:46:33,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4924507397654323874_1405 src: /127.0.0.1:49105 dest: /127.0.0.1:37740
2013-10-31 18:46:33,262 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4924507397654323874_1405 src: /127.0.0.1:52018 dest: /127.0.0.1:34578
2013-10-31 18:46:33,264 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52018, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4924507397654323874_1405, duration: 70530
2013-10-31 18:46:33,264 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4924507397654323874_1405 size 156
2013-10-31 18:46:33,264 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4924507397654323874_1405 terminating
2013-10-31 18:46:33,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49105, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4924507397654323874_1405, duration: 955464
2013-10-31 18:46:33,265 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4924507397654323874_1405 terminating
2013-10-31 18:46:33,266 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45213, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4924507397654323874_1405, duration: 1498172
2013-10-31 18:46:33,266 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4924507397654323874_1405 terminating
2013-10-31 18:46:33,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4924507397654323874_1405 size 156
2013-10-31 18:46:33,269 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:46:33,269 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:46:33,269 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4924507397654323874_1405 size 156
2013-10-31 18:46:33,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,294 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml. blk_7803140496788561719_1406
2013-10-31 18:46:33,295 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7803140496788561719_1406 src: /127.0.0.1:45216 dest: /127.0.0.1:59471
2013-10-31 18:46:33,296 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7803140496788561719_1406 src: /127.0.0.1:52020 dest: /127.0.0.1:34578
2013-10-31 18:46:33,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7803140496788561719_1406 src: /127.0.0.1:49109 dest: /127.0.0.1:37740
2013-10-31 18:46:33,300 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49109, dest: /127.0.0.1:37740, bytes: 28448, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7803140496788561719_1406, duration: 323391
2013-10-31 18:46:33,301 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7803140496788561719_1406 terminating
2013-10-31 18:46:33,301 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52020, dest: /127.0.0.1:34578, bytes: 28448, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7803140496788561719_1406, duration: 1130500
2013-10-31 18:46:33,302 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7803140496788561719_1406 terminating
2013-10-31 18:46:33,302 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7803140496788561719_1406 size 28448
2013-10-31 18:46:33,302 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45216, dest: /127.0.0.1:59471, bytes: 28448, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 2014567
2013-10-31 18:46:33,303 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7803140496788561719_1406 terminating
2013-10-31 18:46:33,305 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7803140496788561719_1406 size 28448
2013-10-31 18:46:33,306 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml from client DFSClient_-1596270109
2013-10-31 18:46:33,306 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:46:33,306 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7803140496788561719_1406 size 28448
2013-10-31 18:46:33,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=null
2013-10-31 18:46:33,323 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45220, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 454838
2013-10-31 18:46:33,338 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0040: nMaps=4 nReduces=1 max=-1
2013-10-31 18:46:33,338 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0040 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:46:33,339 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0040	RESULT=SUCCESS
2013-10-31 18:46:33,339 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0040
2013-10-31 18:46:33,339 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0040
2013-10-31 18:46:33,339 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0040
2013-10-31 18:46:33,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,373 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml. blk_-8600798403005839553_1408
2013-10-31 18:46:33,375 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8600798403005839553_1408 src: /127.0.0.1:52026 dest: /127.0.0.1:34578
2013-10-31 18:46:33,377 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8600798403005839553_1408 src: /127.0.0.1:45224 dest: /127.0.0.1:59471
2013-10-31 18:46:33,378 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8600798403005839553_1408 src: /127.0.0.1:49399 dest: /127.0.0.1:54365
2013-10-31 18:46:33,383 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49399, dest: /127.0.0.1:54365, bytes: 28513, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8600798403005839553_1408, duration: 1012256
2013-10-31 18:46:33,384 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8600798403005839553_1408 terminating
2013-10-31 18:46:33,384 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45224, dest: /127.0.0.1:59471, bytes: 28513, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8600798403005839553_1408, duration: 1899607
2013-10-31 18:46:33,385 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8600798403005839553_1408 terminating
2013-10-31 18:46:33,385 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8600798403005839553_1408 size 28513
2013-10-31 18:46:33,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52026, dest: /127.0.0.1:34578, bytes: 28513, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8600798403005839553_1408, duration: 3574241
2013-10-31 18:46:33,386 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8600798403005839553_1408 terminating
2013-10-31 18:46:33,388 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8600798403005839553_1408 size 28513
2013-10-31 18:46:33,389 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml from client DFSClient_-1340262821
2013-10-31 18:46:33,389 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml is closed by DFSClient_-1340262821
2013-10-31 18:46:33,390 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8600798403005839553_1408 size 28513
2013-10-31 18:46:33,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,406 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken. blk_-6312158700066968443_1409
2013-10-31 18:46:33,407 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6312158700066968443_1409 src: /127.0.0.1:52029 dest: /127.0.0.1:34578
2013-10-31 18:46:33,409 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6312158700066968443_1409 src: /127.0.0.1:45227 dest: /127.0.0.1:59471
2013-10-31 18:46:33,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6312158700066968443_1409 src: /127.0.0.1:49402 dest: /127.0.0.1:54365
2013-10-31 18:46:33,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49402, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6312158700066968443_1409, duration: 658090
2013-10-31 18:46:33,414 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6312158700066968443_1409 terminating
2013-10-31 18:46:33,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45227, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6312158700066968443_1409, duration: 878029
2013-10-31 18:46:33,415 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6312158700066968443_1409 terminating
2013-10-31 18:46:33,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52029, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6312158700066968443_1409, duration: 1867257
2013-10-31 18:46:33,416 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6312158700066968443_1409 terminating
2013-10-31 18:46:33,416 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6312158700066968443_1409 size 116
2013-10-31 18:46:33,418 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken from client DFSClient_-1596270109
2013-10-31 18:46:33,419 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:46:33,419 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6312158700066968443_1409 size 116
2013-10-31 18:46:33,420 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6312158700066968443_1409 size 116
2013-10-31 18:46:33,690 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken
2013-10-31 18:46:33,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:46:33,707 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45230, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4924507397654323874_1405, duration: 12666889
2013-10-31 18:46:33,708 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0040 = 1449. Number of splits = 4
2013-10-31 18:46:33,708 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,711 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,713 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,713 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,713 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0040 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:46:33,716 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0040 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:46:34,138 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0040_m_000005_0' to tip task_20131031182606197_0040_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:34,149 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:46:34,149 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000005_0 which needs 1 slots
2013-10-31 18:46:34,149 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000005_0 which needs 1 slots
2013-10-31 18:46:34,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken	dst=null	perm=null
2013-10-31 18:46:34,158 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52034, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6312158700066968443_1409, duration: 293176
2013-10-31 18:46:34,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=null
2013-10-31 18:46:34,168 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45233, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-1810385824, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 395471
2013-10-31 18:46:34,198 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:34,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=null
2013-10-31 18:46:34,228 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45234, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1810385824, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1798187280963192099_1403, duration: 1165799
2013-10-31 18:46:34,324 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:34,331 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7992 with signal TERM. Exit code 0
2013-10-31 18:46:34,331 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_-976513709
2013-10-31 18:46:34,332 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_-976513709 spawned.
2013-10-31 18:46:34,333 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000005_0/taskjvm.sh
2013-10-31 18:46:34,609 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_1798187280963192099_1403 to datanode(s) 127.0.0.1:54365
2013-10-31 18:46:34,610 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_4955026965077948598_1400
2013-10-31 18:46:34,760 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:35,064 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:35,064 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:35,064 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:35,064 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_902584542 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:46:35,712 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_-976513709 given task: attempt_20131031182606197_0040_m_000005_0
2013-10-31 18:46:36,132 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:36,133 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0039_m_000006_0 not found in cache
2013-10-31 18:46:36,133 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383331596133
2013-10-31 18:46:36,176 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_r_593026137 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:36,181 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8511 with signal TERM. Exit code 0
2013-10-31 18:46:36,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:36,341 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:36,341 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:36,341 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:36,342 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_r_593026137 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:36,437 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_1798187280963192099_1403 to 127.0.0.1:54365 
2013-10-31 18:46:36,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:49411 dest: /127.0.0.1:54365
2013-10-31 18:46:36,439 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_1798187280963192099_1403 to /127.0.0.1:54365
2013-10-31 18:46:36,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1798187280963192099_1403 src: /127.0.0.1:49411 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:46:36,446 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:36,510 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4955026965077948598_1400 file build/test/data/dfs/data/data8/current/blk_4955026965077948598 for deletion
2013-10-31 18:46:36,510 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4955026965077948598_1400 at file build/test/data/dfs/data/data8/current/blk_4955026965077948598
2013-10-31 18:46:36,882 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:36,883 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383331596883
2013-10-31 18:46:36,885 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:36,886 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383331596886
2013-10-31 18:46:37,274 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_1010047912 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,284 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8122 with signal TERM. Exit code 0
2013-10-31 18:46:37,463 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:37,463 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:37,463 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:37,463 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_1010047912 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:46:37,629 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_-1608983854 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,633 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_-387027469 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,641 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8245 with signal TERM. Exit code 0
2013-10-31 18:46:37,644 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8246 with signal TERM. Exit code 0
2013-10-31 18:46:37,816 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_1519844982 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,816 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_-204099648 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,823 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8240 with signal TERM. Exit code 0
2013-10-31 18:46:37,823 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8248 with signal TERM. Exit code 0
2013-10-31 18:46:37,875 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:37,875 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:37,875 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:37,875 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_-1608983854 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:37,878 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:37,878 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:37,878 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:37,878 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_-387027469 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:38,003 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:38,004 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:38,004 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:38,004 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_1519844982 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:38,016 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:38,016 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:38,016 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:46:38,016 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_-204099648 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:39,126 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000005_0 0.0% setup
2013-10-31 18:46:39,129 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000005_0 is done.
2013-10-31 18:46:39,129 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000005_0  was -1
2013-10-31 18:46:39,130 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:40,156 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000005_0' has completed task_20131031182606197_0040_m_000005 successfully.
2013-10-31 18:46:40,161 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000000_0' to tip task_20131031182606197_0040_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:40,164 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000000
2013-10-31 18:46:40,166 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:40,166 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000000_0 which needs 1 slots
2013-10-31 18:46:40,167 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000000_0 which needs 1 slots
2013-10-31 18:46:40,201 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_1560840909
2013-10-31 18:46:40,201 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_1560840909 spawned.
2013-10-31 18:46:40,204 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000000_0/taskjvm.sh
2013-10-31 18:46:40,889 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000001_0' to tip task_20131031182606197_0040_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:46:40,890 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000001
2013-10-31 18:46:40,891 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:46:40,891 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000001_0 which needs 1 slots
2013-10-31 18:46:40,892 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000001_0 which needs 1 slots
2013-10-31 18:46:40,896 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000002_0' to tip task_20131031182606197_0040_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:46:40,897 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000002
2013-10-31 18:46:40,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken	dst=null	perm=null
2013-10-31 18:46:40,898 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:46:40,899 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000002_0 which needs 1 slots
2013-10-31 18:46:40,899 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000002_0 which needs 1 slots
2013-10-31 18:46:40,902 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49413, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6312158700066968443_1409, duration: 282801
2013-10-31 18:46:40,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken	dst=null	perm=null
2013-10-31 18:46:40,905 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49414, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6312158700066968443_1409, duration: 303807
2013-10-31 18:46:40,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=null
2013-10-31 18:46:40,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=null
2013-10-31 18:46:40,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45244, bytes: 28672, op: HDFS_READ, cliID: DFSClient_89036823, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 185293
2013-10-31 18:46:40,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52046, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-73294791, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7803140496788561719_1406, duration: 396056
2013-10-31 18:46:40,932 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:40,938 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:40,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=null
2013-10-31 18:46:40,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49136, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-73294791, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1798187280963192099_1403, duration: 691612
2013-10-31 18:46:40,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=null
2013-10-31 18:46:40,952 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49137, bytes: 239915, op: HDFS_READ, cliID: DFSClient_89036823, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1798187280963192099_1403, duration: 640276
2013-10-31 18:46:40,975 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000003_0' to tip task_20131031182606197_0040_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:46:40,975 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000003
2013-10-31 18:46:40,976 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:46:40,976 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000003_0 which needs 1 slots
2013-10-31 18:46:40,976 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000003_0 which needs 1 slots
2013-10-31 18:46:40,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken	dst=null	perm=null
2013-10-31 18:46:40,980 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52050, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6312158700066968443_1409, duration: 131404
2013-10-31 18:46:40,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml	dst=null	perm=null
2013-10-31 18:46:40,985 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45249, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-1896772921, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 155227
2013-10-31 18:46:40,998 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:41,011 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_85603554
2013-10-31 18:46:41,012 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_85603554 spawned.
2013-10-31 18:46:41,015 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_-512244477
2013-10-31 18:46:41,015 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000002_0/taskjvm.sh
2013-10-31 18:46:41,015 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_-512244477 spawned.
2013-10-31 18:46:41,016 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000001_0/taskjvm.sh
2013-10-31 18:46:41,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar	dst=null	perm=null
2013-10-31 18:46:41,021 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45250, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1896772921, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1798187280963192099_1403, duration: 681117
2013-10-31 18:46:41,040 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_1560840909 given task: attempt_20131031182606197_0040_m_000000_0
2013-10-31 18:46:42,291 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_-1744508755
2013-10-31 18:46:42,293 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_-1744508755 spawned.
2013-10-31 18:46:42,295 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000003_0/taskjvm.sh
2013-10-31 18:46:43,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=null
2013-10-31 18:46:43,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49143, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7967776557441908343_1404, duration: 176507
2013-10-31 18:46:43,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:46:43,163 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49144, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 111164
2013-10-31 18:46:43,525 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_85603554 given task: attempt_20131031182606197_0040_m_000002_0
2013-10-31 18:46:43,652 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_-1744508755 given task: attempt_20131031182606197_0040_m_000003_0
2013-10-31 18:46:43,656 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_-512244477 given task: attempt_20131031182606197_0040_m_000001_0
2013-10-31 18:46:44,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=null
2013-10-31 18:46:44,023 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49432, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7967776557441908343_1404, duration: 225184
2013-10-31 18:46:44,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:46:44,066 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49433, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 166029
2013-10-31 18:46:44,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=null
2013-10-31 18:46:44,152 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49436, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7967776557441908343_1404, duration: 169329
2013-10-31 18:46:44,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split	dst=null	perm=null
2013-10-31 18:46:44,161 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52066, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7967776557441908343_1404, duration: 106172
2013-10-31 18:46:44,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:46:44,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:46:44,201 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52067, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 183655
2013-10-31 18:46:44,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52068, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 176290
2013-10-31 18:46:45,166 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0040_m_000005_0
2013-10-31 18:46:45,167 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0040_m_000005_0
2013-10-31 18:46:45,167 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0040_m_000005_0 not found in cache
2013-10-31 18:46:46,042 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:46:46,045 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000000_0 is done.
2013-10-31 18:46:46,045 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000000_0  was 54
2013-10-31 18:46:46,045 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:46,171 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000000_0' has completed task_20131031182606197_0040_m_000000 successfully.
2013-10-31 18:46:46,173 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0040_r_000000_0' to tip task_20131031182606197_0040_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:46,175 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:46,176 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_r_000000_0 which needs 1 slots
2013-10-31 18:46:46,176 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_r_000000_0 which needs 1 slots
2013-10-31 18:46:46,205 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_r_-378893990
2013-10-31 18:46:46,206 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_r_-378893990 spawned.
2013-10-31 18:46:46,207 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_r_000000_0/taskjvm.sh
2013-10-31 18:46:46,948 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:46:46,950 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000002_0 is done.
2013-10-31 18:46:46,950 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000002_0  was 73
2013-10-31 18:46:46,950 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:47,079 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:46:47,081 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000001_0 is done.
2013-10-31 18:46:47,081 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000001_0  was 74
2013-10-31 18:46:47,081 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:47,088 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:46:47,090 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000003_0 is done.
2013-10-31 18:46:47,090 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000003_0  was 53
2013-10-31 18:46:47,090 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:47,365 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_r_-378893990 given task: attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:46:49,899 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000001_0' has completed task_20131031182606197_0040_m_000001 successfully.
2013-10-31 18:46:49,904 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000002_0' has completed task_20131031182606197_0040_m_000002 successfully.
2013-10-31 18:46:49,984 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000003_0' has completed task_20131031182606197_0040_m_000003 successfully.
2013-10-31 18:46:52,009 INFO  metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 51 raw values into 1 aggregated values, total 55
2013-10-31 18:46:53,025 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:43474, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000000_0, duration: 9004353
2013-10-31 18:46:53,832 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:46:55,184 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   1 OK for attempt_20131031182606197_0040_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:46:55,513 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_6508054468461277982_1338
2013-10-31 18:46:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:46:56,019 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,045 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,045 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:46:56,880 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:46:58,059 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41455, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000001_0, duration: 13354663
2013-10-31 18:46:58,079 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:46153, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000002_0, duration: 13398616
2013-10-31 18:46:58,096 INFO  TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:51112, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000003_0, duration: 12199776
2013-10-31 18:46:58,891 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:46:58,950 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:46:59,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:59,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:59,183 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000. blk_3095433216454494385_1410
2013-10-31 18:46:59,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3095433216454494385_1410 src: /127.0.0.1:49166 dest: /127.0.0.1:37740
2013-10-31 18:46:59,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3095433216454494385_1410 src: /127.0.0.1:49450 dest: /127.0.0.1:54365
2013-10-31 18:46:59,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3095433216454494385_1410 src: /127.0.0.1:52080 dest: /127.0.0.1:34578
2013-10-31 18:46:59,231 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52080, dest: /127.0.0.1:34578, bytes: 131, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0040_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3095433216454494385_1410, duration: 1386162
2013-10-31 18:46:59,233 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3095433216454494385_1410 terminating
2013-10-31 18:46:59,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49450, dest: /127.0.0.1:54365, bytes: 131, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0040_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3095433216454494385_1410, duration: 4300544
2013-10-31 18:46:59,234 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3095433216454494385_1410 terminating
2013-10-31 18:46:59,234 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49166, dest: /127.0.0.1:37740, bytes: 131, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0040_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3095433216454494385_1410, duration: 5049614
2013-10-31 18:46:59,235 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3095433216454494385_1410 terminating
2013-10-31 18:46:59,235 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3095433216454494385_1410 size 131
2013-10-31 18:46:59,239 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3095433216454494385_1410 size 131
2013-10-31 18:46:59,239 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3095433216454494385_1410 size 131
2013-10-31 18:46:59,239 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:46:59,239 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:46:59,276 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0040_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:46:59,277 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) > 
2013-10-31 18:47:01,193 INFO  mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus   3 OK for attempt_20131031182606197_0040_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:47:01,194 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:47:01,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0	dst=null	perm=null
2013-10-31 18:47:01,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:01,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000	dst=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:01,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0	dst=null	perm=null
2013-10-31 18:47:02,935 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 1.0% reduce > reduce
2013-10-31 18:47:02,937 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 1.0% reduce > reduce
2013-10-31 18:47:02,938 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_r_000000_0 is done.
2013-10-31 18:47:02,939 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_r_000000_0  was -1
2013-10-31 18:47:02,939 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:04,198 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_r_000000_0' has completed task_20131031182606197_0040_r_000000 successfully.
2013-10-31 18:47:04,201 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0040_m_000004_0' to tip task_20131031182606197_0040_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:04,203 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:47:04,204 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000004_0 which needs 1 slots
2013-10-31 18:47:04,204 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000004_0 which needs 1 slots
2013-10-31 18:47:04,240 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0040/attempt_20131031182606197_0040_m_000004_0. Attempting to reuse: jvm_20131031182606197_0040_m_1560840909
2013-10-31 18:47:04,615 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_1560840909 given task: attempt_20131031182606197_0040_m_000004_0
2013-10-31 18:47:04,766 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000004_0 0.0% 
2013-10-31 18:47:04,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary	dst=null	perm=null
2013-10-31 18:47:04,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:04,795 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_SUCCESS from client DFSClient_attempt_20131031182606197_0040_m_000004_0
2013-10-31 18:47:04,796 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0040_m_000004_0
2013-10-31 18:47:04,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:04,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,805 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4924507397654323874 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4924507397654323874 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4924507397654323874 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7803140496788561719 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7803140496788561719 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,806 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7803140496788561719 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040	dst=null	perm=null
2013-10-31 18:47:07,615 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_1798187280963192099_1403 blk_4924507397654323874_1405 blk_7803140496788561719_1406 blk_7967776557441908343_1404
2013-10-31 18:47:07,615 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_1798187280963192099_1403 blk_4924507397654323874_1405 blk_7803140496788561719_1406 blk_7967776557441908343_1404
2013-10-31 18:47:07,711 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000004_0 0.0% cleanup
2013-10-31 18:47:07,712 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000004_0 is done.
2013-10-31 18:47:07,713 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000004_0  was -1
2013-10-31 18:47:07,713 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:09,051 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data6/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:09,051 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4924507397654323874_1405 file build/test/data/dfs/data/data6/current/blk_4924507397654323874 for deletion
2013-10-31 18:47:09,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7803140496788561719_1406 file build/test/data/dfs/data/data5/current/blk_7803140496788561719 for deletion
2013-10-31 18:47:09,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data6/current/blk_1798187280963192099
2013-10-31 18:47:09,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7803140496788561719_1406 at file build/test/data/dfs/data/data5/current/blk_7803140496788561719
2013-10-31 18:47:09,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4924507397654323874_1405 at file build/test/data/dfs/data/data6/current/blk_4924507397654323874
2013-10-31 18:47:09,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data5/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:09,053 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data5/current/blk_7967776557441908343
2013-10-31 18:47:09,204 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:47:09,204 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:47:09,520 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data8/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4924507397654323874_1405 file build/test/data/dfs/data/data8/current/blk_4924507397654323874 for deletion
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7803140496788561719_1406 file build/test/data/dfs/data/data7/current/blk_7803140496788561719 for deletion
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data8/current/blk_1798187280963192099
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data7/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4924507397654323874_1405 at file build/test/data/dfs/data/data8/current/blk_4924507397654323874
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7803140496788561719_1406 at file build/test/data/dfs/data/data7/current/blk_7803140496788561719
2013-10-31 18:47:09,521 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data7/current/blk_7967776557441908343
2013-10-31 18:47:10,211 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000004_0' has completed task_20131031182606197_0040_m_000004 successfully.
2013-10-31 18:47:10,212 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0040 has completed successfully.
2013-10-31 18:47:10,213 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0040,submitTime=1383245193313,launchTime=1383245193715,firstMapTaskLaunchTime=1383245200161,firstReduceTaskLaunchTime=1383245206173,firstJobSetupTaskLaunchTime=1383245194138,firstJobCleanupTaskLaunchTime=1383245224200,finishTime=1383245230212,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FFFD8058FD054FB8AFF66C79650750C9/896A269D29444F36B2F51092499887F5] left+right/(1/3)
2013-10-31 18:47:10,217 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36. blk_-8506542354890884660_1411
2013-10-31 18:47:10,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8506542354890884660_1411 src: /127.0.0.1:45280 dest: /127.0.0.1:59471
2013-10-31 18:47:10,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8506542354890884660_1411 src: /127.0.0.1:52084 dest: /127.0.0.1:34578
2013-10-31 18:47:10,224 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8506542354890884660_1411 src: /127.0.0.1:49456 dest: /127.0.0.1:54365
2013-10-31 18:47:10,236 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49456, dest: /127.0.0.1:54365, bytes: 28278, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8506542354890884660_1411, duration: 8671695
2013-10-31 18:47:10,236 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8506542354890884660_1411 terminating
2013-10-31 18:47:10,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52084, dest: /127.0.0.1:34578, bytes: 28278, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8506542354890884660_1411, duration: 8491880
2013-10-31 18:47:10,237 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8506542354890884660_1411 terminating
2013-10-31 18:47:10,238 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45280, dest: /127.0.0.1:59471, bytes: 28278, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8506542354890884660_1411, duration: 10549411
2013-10-31 18:47:10,238 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8506542354890884660_1411 terminating
2013-10-31 18:47:10,241 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8506542354890884660_1411 size 28278
2013-10-31 18:47:10,241 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 from client DFSClient_-1340262821
2013-10-31 18:47:10,241 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 is closed by DFSClient_-1340262821
2013-10-31 18:47:10,241 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8506542354890884660_1411 size 28278
2013-10-31 18:47:10,242 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8506542354890884660_1411 size 28278
2013-10-31 18:47:10,247 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:10,248 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000000_0'
2013-10-31 18:47:10,249 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000004_0'
2013-10-31 18:47:10,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6312158700066968443 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:10,249 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6312158700066968443 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:10,250 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6312158700066968443 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:10,249 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000005_0'
2013-10-31 18:47:10,250 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0040_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:10,250 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_r_000000_0'
2013-10-31 18:47:10,253 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (2/3) ...dpipesplatform/splitcomp2
2013-10-31 18:47:10,253 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (3/3) ...dpipesplatform/splitcomp1
2013-10-31 18:47:10,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040	dst=null	perm=null
2013-10-31 18:47:10,257 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:47:10,257 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:47:10,258 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:47:10,258 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:47:10,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:10,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:47:10,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:10,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:47:10,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:10,284 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar. blk_-2565091071161671132_1412
2013-10-31 18:47:10,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:52087 dest: /127.0.0.1:34578
2013-10-31 18:47:10,288 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:49176 dest: /127.0.0.1:37740
2013-10-31 18:47:10,289 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:45286 dest: /127.0.0.1:59471
2013-10-31 18:47:10,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:10,293 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar. blk_3570503195496497577_1413
2013-10-31 18:47:10,294 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45286, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2565091071161671132_1412, duration: 1558803
2013-10-31 18:47:10,294 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:45287 dest: /127.0.0.1:59471
2013-10-31 18:47:10,294 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2565091071161671132_1412 terminating
2013-10-31 18:47:10,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49176, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2565091071161671132_1412, duration: 2571086
2013-10-31 18:47:10,295 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:52091 dest: /127.0.0.1:34578
2013-10-31 18:47:10,295 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2565091071161671132_1412 terminating
2013-10-31 18:47:10,296 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52087, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2565091071161671132_1412, duration: 3618267
2013-10-31 18:47:10,296 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2565091071161671132_1412 terminating
2013-10-31 18:47:10,307 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:49180 dest: /127.0.0.1:37740
2013-10-31 18:47:10,307 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:10,307 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar from client DFSClient_-1596270109
2013-10-31 18:47:10,307 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:47:10,307 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:10,307 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:10,316 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar. New replication is 10
2013-10-31 18:47:10,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar	dst=null	perm=null
2013-10-31 18:47:10,332 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49180, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3570503195496497577_1413, duration: 17535199
2013-10-31 18:47:10,333 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:10,333 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3570503195496497577_1413 terminating
2013-10-31 18:47:10,333 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52091, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3570503195496497577_1413, duration: 17422729
2013-10-31 18:47:10,333 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3570503195496497577_1413 terminating
2013-10-31 18:47:10,334 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45287, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3570503195496497577_1413, duration: 20509370
2013-10-31 18:47:10,334 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:10,336 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3570503195496497577_1413 terminating
2013-10-31 18:47:10,336 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:10,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:10,339 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:47:10,339 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar from client DFSClient_-1596270109
2013-10-31 18:47:10,339 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:47:10,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1	dst=null	perm=null
2013-10-31 18:47:10,382 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:10,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000	dst=null	perm=null
2013-10-31 18:47:10,616 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-2565091071161671132_1412 to datanode(s) 127.0.0.1:54365
2013-10-31 18:47:10,616 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_1798187280963192099_1403 blk_4924507397654323874_1405 blk_7803140496788561719_1406 blk_-6312158700066968443_1409 blk_7967776557441908343_1404
2013-10-31 18:47:10,616 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_1798187280963192099_1403 blk_-6312158700066968443_1409 blk_7967776557441908343_1404
2013-10-31 18:47:10,924 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000001_0'
2013-10-31 18:47:10,928 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000002_0'
2013-10-31 18:47:11,005 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000003_0'
2013-10-31 18:47:11,059 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar. New replication is 10
2013-10-31 18:47:11,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar	dst=null	perm=null
2013-10-31 18:47:11,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,082 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split. New replication is 10
2013-10-31 18:47:11,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,086 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:47:11,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1	dst=null	perm=null
2013-10-31 18:47:11,091 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:11,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000	dst=null	perm=null
2013-10-31 18:47:11,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split	dst=null	perm=null
2013-10-31 18:47:11,095 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split. blk_3499764083074527036_1415
2013-10-31 18:47:11,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:49464 dest: /127.0.0.1:54365
2013-10-31 18:47:11,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:45291 dest: /127.0.0.1:59471
2013-10-31 18:47:11,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:49183 dest: /127.0.0.1:37740
2013-10-31 18:47:11,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:52096 dest: /127.0.0.1:34578
2013-10-31 18:47:11,108 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52096, dest: /127.0.0.1:34578, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3499764083074527036_1415, duration: 73222
2013-10-31 18:47:11,108 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,108 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,108 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49183, dest: /127.0.0.1:37740, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3499764083074527036_1415, duration: 2919134
2013-10-31 18:47:11,109 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,109 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45291, dest: /127.0.0.1:59471, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3499764083074527036_1415, duration: 3866508
2013-10-31 18:47:11,110 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,110 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,110 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49464, dest: /127.0.0.1:54365, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3499764083074527036_1415, duration: 4756833
2013-10-31 18:47:11,111 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,116 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,116 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split from client DFSClient_-1596270109
2013-10-31 18:47:11,117 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split is closed by DFSClient_-1596270109
2013-10-31 18:47:11,117 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,128 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split. New replication is 10
2013-10-31 18:47:11,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split	dst=null	perm=null
2013-10-31 18:47:11,140 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split. blk_-5014300393221569912_1416
2013-10-31 18:47:11,141 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:45294 dest: /127.0.0.1:59471
2013-10-31 18:47:11,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,143 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:52098 dest: /127.0.0.1:34578
2013-10-31 18:47:11,145 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:49187 dest: /127.0.0.1:37740
2013-10-31 18:47:11,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:49471 dest: /127.0.0.1:54365
2013-10-31 18:47:11,152 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49471, dest: /127.0.0.1:54365, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5014300393221569912_1416, duration: 1920060
2013-10-31 18:47:11,152 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,153 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,153 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49187, dest: /127.0.0.1:37740, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5014300393221569912_1416, duration: 3676750
2013-10-31 18:47:11,153 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,154 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52098, dest: /127.0.0.1:34578, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5014300393221569912_1416, duration: 4486445
2013-10-31 18:47:11,154 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,154 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,155 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45294, dest: /127.0.0.1:59471, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5014300393221569912_1416, duration: 5480929
2013-10-31 18:47:11,156 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,156 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,159 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,159 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split from client DFSClient_-1596270109
2013-10-31 18:47:11,159 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split is closed by DFSClient_-1596270109
2013-10-31 18:47:11,160 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo. blk_2605274129487483737_1416
2013-10-31 18:47:11,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2605274129487483737_1416 src: /127.0.0.1:52101 dest: /127.0.0.1:34578
2013-10-31 18:47:11,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2605274129487483737_1416 src: /127.0.0.1:49190 dest: /127.0.0.1:37740
2013-10-31 18:47:11,165 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2605274129487483737_1416 src: /127.0.0.1:45300 dest: /127.0.0.1:59471
2013-10-31 18:47:11,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45300, dest: /127.0.0.1:59471, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2605274129487483737_1416, duration: 544183
2013-10-31 18:47:11,169 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2605274129487483737_1416 terminating
2013-10-31 18:47:11,169 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49190, dest: /127.0.0.1:37740, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2605274129487483737_1416, duration: 1321596
2013-10-31 18:47:11,169 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2605274129487483737_1416 terminating
2013-10-31 18:47:11,170 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52101, dest: /127.0.0.1:34578, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2605274129487483737_1416, duration: 2171893
2013-10-31 18:47:11,170 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2605274129487483737_1416 terminating
2013-10-31 18:47:11,174 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2605274129487483737_1416 size 44
2013-10-31 18:47:11,174 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:47:11,175 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:47:11,175 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2605274129487483737_1416 size 44
2013-10-31 18:47:11,176 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2605274129487483737_1416 size 44
2013-10-31 18:47:11,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,192 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo. blk_5953021751685955983_1418
2013-10-31 18:47:11,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,194 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5953021751685955983_1418 src: /127.0.0.1:52104 dest: /127.0.0.1:34578
2013-10-31 18:47:11,195 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5953021751685955983_1418 src: /127.0.0.1:45302 dest: /127.0.0.1:59471
2013-10-31 18:47:11,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5953021751685955983_1418 src: /127.0.0.1:49477 dest: /127.0.0.1:54365
2013-10-31 18:47:11,200 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49477, dest: /127.0.0.1:54365, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5953021751685955983_1418, duration: 68724
2013-10-31 18:47:11,200 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5953021751685955983_1418 terminating
2013-10-31 18:47:11,200 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45302, dest: /127.0.0.1:59471, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5953021751685955983_1418, duration: 858081
2013-10-31 18:47:11,201 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5953021751685955983_1418 terminating
2013-10-31 18:47:11,201 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52104, dest: /127.0.0.1:34578, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5953021751685955983_1418, duration: 1733917
2013-10-31 18:47:11,201 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5953021751685955983_1418 size 44
2013-10-31 18:47:11,202 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5953021751685955983_1418 terminating
2013-10-31 18:47:11,204 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:47:11,205 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:47:11,205 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5953021751685955983_1418 size 44
2013-10-31 18:47:11,206 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5953021751685955983_1418 size 44
2013-10-31 18:47:11,211 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml. blk_-8036325246898089699_1418
2013-10-31 18:47:11,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036325246898089699_1418 src: /127.0.0.1:52107 dest: /127.0.0.1:34578
2013-10-31 18:47:11,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036325246898089699_1418 src: /127.0.0.1:49196 dest: /127.0.0.1:37740
2013-10-31 18:47:11,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036325246898089699_1418 src: /127.0.0.1:45306 dest: /127.0.0.1:59471
2013-10-31 18:47:11,219 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45306, dest: /127.0.0.1:59471, bytes: 28098, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8036325246898089699_1418, duration: 654776
2013-10-31 18:47:11,220 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8036325246898089699_1418 terminating
2013-10-31 18:47:11,220 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49196, dest: /127.0.0.1:37740, bytes: 28098, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036325246898089699_1418, duration: 1439103
2013-10-31 18:47:11,221 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8036325246898089699_1418 terminating
2013-10-31 18:47:11,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52107, dest: /127.0.0.1:34578, bytes: 28098, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036325246898089699_1418, duration: 2329956
2013-10-31 18:47:11,221 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8036325246898089699_1418 terminating
2013-10-31 18:47:11,223 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8036325246898089699_1418 size 28098
2013-10-31 18:47:11,223 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8036325246898089699_1418 size 28098
2013-10-31 18:47:11,224 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml from client DFSClient_-1596270109
2013-10-31 18:47:11,238 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:47:11,238 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8036325246898089699_1418 size 28098
2013-10-31 18:47:11,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6312158700066968443_1409 file build/test/data/dfs/data/data4/current/blk_-6312158700066968443 for deletion
2013-10-31 18:47:11,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data3/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:11,323 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6312158700066968443_1409 at file build/test/data/dfs/data/data4/current/blk_-6312158700066968443
2013-10-31 18:47:11,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data4/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:11,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data3/current/blk_1798187280963192099
2013-10-31 18:47:11,324 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data4/current/blk_7967776557441908343
2013-10-31 18:47:11,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml	dst=null	perm=null
2013-10-31 18:47:11,526 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52111, bytes: 28318, op: HDFS_READ, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036325246898089699_1418, duration: 410423
2013-10-31 18:47:11,545 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0041: nMaps=1 nReduces=0 max=-1
2013-10-31 18:47:11,545 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0041 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:47:11,545 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0041
2013-10-31 18:47:11,545 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0041	RESULT=SUCCESS
2013-10-31 18:47:11,546 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0041
2013-10-31 18:47:11,547 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0041
2013-10-31 18:47:11,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,562 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml. blk_-812474416209307718_1420
2013-10-31 18:47:11,564 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-812474416209307718_1420 src: /127.0.0.1:49483 dest: /127.0.0.1:54365
2013-10-31 18:47:11,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-812474416209307718_1420 src: /127.0.0.1:49201 dest: /127.0.0.1:37740
2013-10-31 18:47:11,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-812474416209307718_1420 src: /127.0.0.1:52114 dest: /127.0.0.1:34578
2013-10-31 18:47:11,570 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52114, dest: /127.0.0.1:34578, bytes: 28102, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-812474416209307718_1420, duration: 71960
2013-10-31 18:47:11,570 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-812474416209307718_1420 terminating
2013-10-31 18:47:11,570 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-812474416209307718_1420 size 28102
2013-10-31 18:47:11,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49201, dest: /127.0.0.1:37740, bytes: 28102, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-812474416209307718_1420, duration: 1039926
2013-10-31 18:47:11,571 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-812474416209307718_1420 size 28102
2013-10-31 18:47:11,572 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-812474416209307718_1420 terminating
2013-10-31 18:47:11,572 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49483, dest: /127.0.0.1:54365, bytes: 28102, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-812474416209307718_1420, duration: 2147999
2013-10-31 18:47:11,573 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-812474416209307718_1420 terminating
2013-10-31 18:47:11,575 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml from client DFSClient_-1596270109
2013-10-31 18:47:11,575 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:47:11,576 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-812474416209307718_1420 size 28102
2013-10-31 18:47:11,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,584 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml. blk_2769756318727575082_1421
2013-10-31 18:47:11,587 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2769756318727575082_1421 src: /127.0.0.1:45312 dest: /127.0.0.1:59471
2013-10-31 18:47:11,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2769756318727575082_1421 src: /127.0.0.1:52117 dest: /127.0.0.1:34578
2013-10-31 18:47:11,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2769756318727575082_1421 src: /127.0.0.1:49206 dest: /127.0.0.1:37740
2013-10-31 18:47:11,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml	dst=null	perm=null
2013-10-31 18:47:11,594 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49206, dest: /127.0.0.1:37740, bytes: 28163, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2769756318727575082_1421, duration: 584798
2013-10-31 18:47:11,595 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2769756318727575082_1421 terminating
2013-10-31 18:47:11,595 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2769756318727575082_1421 size 28163
2013-10-31 18:47:11,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52117, dest: /127.0.0.1:34578, bytes: 28163, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2769756318727575082_1421, duration: 1816574
2013-10-31 18:47:11,596 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2769756318727575082_1421 terminating
2013-10-31 18:47:11,596 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49490, bytes: 28322, op: HDFS_READ, cliID: DFSClient_1645291425, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-812474416209307718_1420, duration: 396625
2013-10-31 18:47:11,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45312, dest: /127.0.0.1:59471, bytes: 28163, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2769756318727575082_1421, duration: 2715086
2013-10-31 18:47:11,597 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2769756318727575082_1421 size 28163
2013-10-31 18:47:11,597 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2769756318727575082_1421 terminating
2013-10-31 18:47:11,602 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2769756318727575082_1421 size 28163
2013-10-31 18:47:11,603 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml from client DFSClient_747896772
2013-10-31 18:47:11,603 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml is closed by DFSClient_747896772
2013-10-31 18:47:11,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,619 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken. blk_7668973597655018822_1422
2013-10-31 18:47:11,620 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0042: nMaps=1 nReduces=0 max=-1
2013-10-31 18:47:11,620 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0042 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:47:11,620 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0042
2013-10-31 18:47:11,620 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0042	RESULT=SUCCESS
2013-10-31 18:47:11,621 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0042
2013-10-31 18:47:11,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7668973597655018822_1422 src: /127.0.0.1:49491 dest: /127.0.0.1:54365
2013-10-31 18:47:11,622 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0042
2013-10-31 18:47:11,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7668973597655018822_1422 src: /127.0.0.1:52121 dest: /127.0.0.1:34578
2013-10-31 18:47:11,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7668973597655018822_1422 src: /127.0.0.1:49210 dest: /127.0.0.1:37740
2013-10-31 18:47:11,629 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49210, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7668973597655018822_1422, duration: 420301
2013-10-31 18:47:11,629 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7668973597655018822_1422 terminating
2013-10-31 18:47:11,629 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52121, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7668973597655018822_1422, duration: 1189586
2013-10-31 18:47:11,630 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7668973597655018822_1422 size 116
2013-10-31 18:47:11,630 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7668973597655018822_1422 terminating
2013-10-31 18:47:11,630 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49491, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7668973597655018822_1422, duration: 2200795
2013-10-31 18:47:11,631 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7668973597655018822_1422 terminating
2013-10-31 18:47:11,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,633 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7668973597655018822_1422 size 116
2013-10-31 18:47:11,634 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken from client DFSClient_-1596270109
2013-10-31 18:47:11,634 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:47:11,635 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7668973597655018822_1422 size 116
2013-10-31 18:47:11,642 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken
2013-10-31 18:47:11,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:47:11,646 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52123, bytes: 48, op: HDFS_READ, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2605274129487483737_1416, duration: 259136
2013-10-31 18:47:11,646 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0041 = 131. Number of splits = 1
2013-10-31 18:47:11,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0041_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:11,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0041_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:11,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0041_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:11,647 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0041 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:47:11,648 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0041 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 18:47:11,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,656 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml. blk_5835570393058213680_1424
2013-10-31 18:47:11,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5835570393058213680_1424 src: /127.0.0.1:45321 dest: /127.0.0.1:59471
2013-10-31 18:47:11,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5835570393058213680_1424 src: /127.0.0.1:49213 dest: /127.0.0.1:37740
2013-10-31 18:47:11,661 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5835570393058213680_1424 src: /127.0.0.1:49497 dest: /127.0.0.1:54365
2013-10-31 18:47:11,666 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49497, dest: /127.0.0.1:54365, bytes: 28167, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5835570393058213680_1424, duration: 949622
2013-10-31 18:47:11,666 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5835570393058213680_1424 terminating
2013-10-31 18:47:11,667 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49213, dest: /127.0.0.1:37740, bytes: 28167, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5835570393058213680_1424, duration: 1828402
2013-10-31 18:47:11,667 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5835570393058213680_1424 terminating
2013-10-31 18:47:11,668 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45321, dest: /127.0.0.1:59471, bytes: 28167, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5835570393058213680_1424, duration: 2930535
2013-10-31 18:47:11,668 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5835570393058213680_1424 terminating
2013-10-31 18:47:11,668 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5835570393058213680_1424 size 28167
2013-10-31 18:47:11,671 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5835570393058213680_1424 size 28167
2013-10-31 18:47:11,672 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5835570393058213680_1424 size 28167
2013-10-31 18:47:11,672 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml from client DFSClient_1645291425
2013-10-31 18:47:11,673 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml is closed by DFSClient_1645291425
2013-10-31 18:47:11,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,683 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken. blk_92448142914914131_1425
2013-10-31 18:47:11,685 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_92448142914914131_1425 src: /127.0.0.1:45324 dest: /127.0.0.1:59471
2013-10-31 18:47:11,686 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_92448142914914131_1425 src: /127.0.0.1:49499 dest: /127.0.0.1:54365
2013-10-31 18:47:11,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_92448142914914131_1425 src: /127.0.0.1:52129 dest: /127.0.0.1:34578
2013-10-31 18:47:11,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52129, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_92448142914914131_1425, duration: 552703
2013-10-31 18:47:11,692 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_92448142914914131_1425 terminating
2013-10-31 18:47:11,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49499, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_92448142914914131_1425, duration: 1303032
2013-10-31 18:47:11,693 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_92448142914914131_1425 terminating
2013-10-31 18:47:11,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45324, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_92448142914914131_1425, duration: 2171728
2013-10-31 18:47:11,693 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_92448142914914131_1425 size 116
2013-10-31 18:47:11,694 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_92448142914914131_1425 terminating
2013-10-31 18:47:11,696 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_92448142914914131_1425 size 116
2013-10-31 18:47:11,697 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_92448142914914131_1425 size 116
2013-10-31 18:47:11,698 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken from client DFSClient_-1596270109
2013-10-31 18:47:11,698 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:47:12,041 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken
2013-10-31 18:47:12,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:47:12,045 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45327, bytes: 48, op: HDFS_READ, cliID: DFSClient_1645291425, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5953021751685955983_1418, duration: 264329
2013-10-31 18:47:12,045 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0042 = 131. Number of splits = 1
2013-10-31 18:47:12,045 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0042_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:12,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0042_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:12,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0042_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:12,046 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0042 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:47:12,047 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0042 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 18:47:12,051 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-2565091071161671132_1412 to 127.0.0.1:54365 
2013-10-31 18:47:12,053 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:49502 dest: /127.0.0.1:54365
2013-10-31 18:47:12,054 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-2565091071161671132_1412 to /127.0.0.1:54365
2013-10-31 18:47:12,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2565091071161671132_1412 src: /127.0.0.1:49502 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:47:12,059 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:12,449 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6312158700066968443_1409 file build/test/data/dfs/data/data1/current/blk_-6312158700066968443 for deletion
2013-10-31 18:47:12,449 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data2/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:12,449 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6312158700066968443_1409 at file build/test/data/dfs/data/data1/current/blk_-6312158700066968443
2013-10-31 18:47:12,449 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4924507397654323874_1405 file build/test/data/dfs/data/data2/current/blk_4924507397654323874 for deletion
2013-10-31 18:47:12,449 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data2/current/blk_1798187280963192099
2013-10-31 18:47:12,450 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7803140496788561719_1406 file build/test/data/dfs/data/data1/current/blk_7803140496788561719 for deletion
2013-10-31 18:47:12,450 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4924507397654323874_1405 at file build/test/data/dfs/data/data2/current/blk_4924507397654323874
2013-10-31 18:47:12,450 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data1/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:12,450 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7803140496788561719_1406 at file build/test/data/dfs/data/data1/current/blk_7803140496788561719
2013-10-31 18:47:12,451 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data1/current/blk_7967776557441908343
2013-10-31 18:47:13,256 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0041_m_000002_0' to tip task_20131031182606197_0041_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:13,262 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0041_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:47:13,262 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0041_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,263 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0041_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken	dst=null	perm=null
2013-10-31 18:47:13,271 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49503, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7668973597655018822_1422, duration: 356123
2013-10-31 18:47:13,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml	dst=null	perm=null
2013-10-31 18:47:13,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52134, bytes: 28318, op: HDFS_READ, cliID: DFSClient_436831636, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036325246898089699_1418, duration: 373943
2013-10-31 18:47:13,308 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:13,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar	dst=null	perm=null
2013-10-31 18:47:13,341 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52135, bytes: 239915, op: HDFS_READ, cliID: DFSClient_436831636, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2565091071161671132_1412, duration: 1436074
2013-10-31 18:47:13,435 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0040_m_-976513709
2013-10-31 18:47:13,447 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8733 with signal TERM. Exit code 0
2013-10-31 18:47:13,447 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0041_m_-941277400
2013-10-31 18:47:13,448 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0041_m_-941277400 spawned.
2013-10-31 18:47:13,451 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0041/attempt_20131031182606197_0041_m_000002_0/taskjvm.sh
2013-10-31 18:47:13,617 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_3570503195496497577_1413 to datanode(s) 127.0.0.1:54365
2013-10-31 18:47:13,618 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-6312158700066968443_1409
2013-10-31 18:47:13,927 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0042_m_000002_0' to tip task_20131031182606197_0042_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:13,930 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0042_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:47:13,930 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0042_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,930 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0042_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken	dst=null	perm=null
2013-10-31 18:47:13,934 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45333, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_92448142914914131_1425, duration: 153591
2013-10-31 18:47:13,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml	dst=null	perm=null
2013-10-31 18:47:13,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52138, bytes: 28322, op: HDFS_READ, cliID: DFSClient_370820543, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-812474416209307718_1420, duration: 200164
2013-10-31 18:47:13,951 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:13,951 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:13,951 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:13,952 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_-976513709 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:13,952 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:13,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar	dst=null	perm=null
2013-10-31 18:47:13,966 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52139, bytes: 239915, op: HDFS_READ, cliID: DFSClient_370820543, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3570503195496497577_1413, duration: 594921
2013-10-31 18:47:14,016 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0042_m_-1590574539
2013-10-31 18:47:14,016 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0042_m_-1590574539 spawned.
2013-10-31 18:47:14,017 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0042/attempt_20131031182606197_0042_m_000002_0/taskjvm.sh
2013-10-31 18:47:14,678 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0041_m_-941277400 given task: attempt_20131031182606197_0041_m_000002_0
2013-10-31 18:47:15,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6312158700066968443_1409 file build/test/data/dfs/data/data5/current/blk_-6312158700066968443 for deletion
2013-10-31 18:47:15,052 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6312158700066968443_1409 at file build/test/data/dfs/data/data5/current/blk_-6312158700066968443
2013-10-31 18:47:15,078 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0042_m_-1590574539 given task: attempt_20131031182606197_0042_m_000002_0
2013-10-31 18:47:15,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:15,251 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:15,251 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0040_m_000004_0 not found in cache
2013-10-31 18:47:15,251 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331635251
2013-10-31 18:47:15,450 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_3570503195496497577_1413 to 127.0.0.1:54365 
2013-10-31 18:47:15,451 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:49515 dest: /127.0.0.1:54365
2013-10-31 18:47:15,452 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_3570503195496497577_1413 to /127.0.0.1:54365
2013-10-31 18:47:15,453 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3570503195496497577_1413 src: /127.0.0.1:49515 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:47:15,457 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:15,477 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_r_-378893990 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:15,484 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9178 with signal TERM. Exit code 0
2013-10-31 18:47:15,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:15,637 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:15,637 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:15,637 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:15,637 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_r_-378893990 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:15,752 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_1560840909 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:15,761 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8893 with signal TERM. Exit code 0
2013-10-31 18:47:15,925 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:15,926 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331635926
2013-10-31 18:47:15,929 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:15,930 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331635930
2013-10-31 18:47:15,943 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:15,943 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:15,943 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:15,944 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_1560840909 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:47:16,006 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:16,007 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331636007
2013-10-31 18:47:16,016 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_85603554 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:16,025 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8994 with signal TERM. Exit code 0
2013-10-31 18:47:16,148 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_-512244477 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:16,154 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_-1744508755 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:16,157 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9036 with signal TERM. Exit code 0
2013-10-31 18:47:16,159 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9035 with signal TERM. Exit code 0
2013-10-31 18:47:16,230 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:16,230 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:16,230 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:16,231 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_85603554 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:16,365 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:16,365 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:16,365 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:16,366 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_-1744508755 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:16,379 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:16,379 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:16,379 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:16,380 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_-512244477 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:18,098 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000002_0 0.0% setup
2013-10-31 18:47:18,101 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0041_m_000002_0 is done.
2013-10-31 18:47:18,102 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0041_m_000002_0  was -1
2013-10-31 18:47:18,102 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:18,498 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000002_0 0.0% setup
2013-10-31 18:47:18,500 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0042_m_000002_0 is done.
2013-10-31 18:47:18,500 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0042_m_000002_0  was -1
2013-10-31 18:47:18,501 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:19,266 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0041_m_000002_0' has completed task_20131031182606197_0041_m_000002 successfully.
2013-10-31 18:47:19,270 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0041_m_000000_0' to tip task_20131031182606197_0041_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:19,271 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0041_m_000000
2013-10-31 18:47:19,272 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0041_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:47:19,272 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0041_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,273 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0041_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,316 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0041_m_731880323
2013-10-31 18:47:19,317 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0041_m_731880323 spawned.
2013-10-31 18:47:19,320 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0041/attempt_20131031182606197_0041_m_000000_0/taskjvm.sh
2013-10-31 18:47:19,936 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0042_m_000002_0' has completed task_20131031182606197_0042_m_000002 successfully.
2013-10-31 18:47:19,938 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0042_m_000000_0' to tip task_20131031182606197_0042_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:19,938 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0042_m_000000
2013-10-31 18:47:19,940 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0042_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:47:19,940 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0042_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,940 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0042_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,955 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0042_m_-1110644511
2013-10-31 18:47:19,956 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0042_m_-1110644511 spawned.
2013-10-31 18:47:19,957 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0042/attempt_20131031182606197_0042_m_000000_0/taskjvm.sh
2013-10-31 18:47:20,388 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0041_m_731880323 given task: attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:20,796 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0042_m_-1110644511 given task: attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:20,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split	dst=null	perm=null
2013-10-31 18:47:20,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52149, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3499764083074527036_1415, duration: 185487
2013-10-31 18:47:20,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000	dst=null	perm=null
2013-10-31 18:47:20,932 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49521, bytes: 135, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3095433216454494385_1410, duration: 121173
2013-10-31 18:47:20,954 INFO  namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2222 Total time for transactions(ms): 38Number of transactions batched in Syncs: 184 Number of syncs: 1563 SyncTimes(ms): 88927 20659 
2013-10-31 18:47:20,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:20,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:21,153 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000. blk_-7992408142071818202_1426
2013-10-31 18:47:21,180 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7992408142071818202_1426 src: /127.0.0.1:49522 dest: /127.0.0.1:54365
2013-10-31 18:47:21,181 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7992408142071818202_1426 src: /127.0.0.1:45349 dest: /127.0.0.1:59471
2013-10-31 18:47:21,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7992408142071818202_1426 src: /127.0.0.1:52153 dest: /127.0.0.1:34578
2013-10-31 18:47:21,184 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52153, dest: /127.0.0.1:34578, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7992408142071818202_1426, duration: 1081310
2013-10-31 18:47:21,185 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7992408142071818202_1426 terminating
2013-10-31 18:47:21,185 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45349, dest: /127.0.0.1:59471, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7992408142071818202_1426, duration: 1452530
2013-10-31 18:47:21,185 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7992408142071818202_1426 terminating
2013-10-31 18:47:21,185 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49522, dest: /127.0.0.1:54365, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7992408142071818202_1426, duration: 1844483
2013-10-31 18:47:21,185 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7992408142071818202_1426 terminating
2013-10-31 18:47:21,186 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7992408142071818202_1426 size 16
2013-10-31 18:47:21,186 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:21,186 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:21,189 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7992408142071818202_1426 size 16
2013-10-31 18:47:21,189 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7992408142071818202_1426 size 16
2013-10-31 18:47:21,234 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0041_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:21,234 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000000_0 0.0% 
2013-10-31 18:47:21,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split	dst=null	perm=null
2013-10-31 18:47:21,302 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52155, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5014300393221569912_1416, duration: 118353
2013-10-31 18:47:21,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000	dst=null	perm=null
2013-10-31 18:47:21,341 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52156, bytes: 135, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3095433216454494385_1410, duration: 257760
2013-10-31 18:47:21,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:21,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:21,573 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000. blk_506252283718536132_1427
2013-10-31 18:47:21,610 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_506252283718536132_1427 src: /127.0.0.1:52157 dest: /127.0.0.1:34578
2013-10-31 18:47:21,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_506252283718536132_1427 src: /127.0.0.1:49529 dest: /127.0.0.1:54365
2013-10-31 18:47:21,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_506252283718536132_1427 src: /127.0.0.1:49247 dest: /127.0.0.1:37740
2013-10-31 18:47:21,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49247, dest: /127.0.0.1:37740, bytes: 17, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_506252283718536132_1427, duration: 1203618
2013-10-31 18:47:21,614 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_506252283718536132_1427 terminating
2013-10-31 18:47:21,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49529, dest: /127.0.0.1:54365, bytes: 17, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_506252283718536132_1427, duration: 1379052
2013-10-31 18:47:21,614 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_506252283718536132_1427 terminating
2013-10-31 18:47:21,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52157, dest: /127.0.0.1:34578, bytes: 17, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_506252283718536132_1427, duration: 1794018
2013-10-31 18:47:21,615 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_506252283718536132_1427 terminating
2013-10-31 18:47:21,615 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_506252283718536132_1427 size 17
2013-10-31 18:47:21,615 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:21,616 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:21,617 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_506252283718536132_1427 size 17
2013-10-31 18:47:21,617 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_506252283718536132_1427 size 17
2013-10-31 18:47:21,663 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0042_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:21,663 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000000_0 0.0% 
2013-10-31 18:47:22,278 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:22,944 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:23,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0	dst=null	perm=null
2013-10-31 18:47:23,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:23,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:23,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0	dst=null	perm=null
2013-10-31 18:47:23,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0	dst=null	perm=null
2013-10-31 18:47:23,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:23,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:23,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0	dst=null	perm=null
2013-10-31 18:47:23,816 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000:0+131
2013-10-31 18:47:23,818 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0041_m_000000_0 is done.
2013-10-31 18:47:23,818 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0041_m_000000_0  was -1
2013-10-31 18:47:23,818 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:24,230 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000:0+131
2013-10-31 18:47:24,232 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0042_m_000000_0 is done.
2013-10-31 18:47:24,232 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0042_m_000000_0  was -1
2013-10-31 18:47:24,232 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:24,273 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0041_m_000002_0
2013-10-31 18:47:24,273 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0041_m_000002_0
2013-10-31 18:47:24,273 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0041_m_000002_0 not found in cache
2013-10-31 18:47:24,940 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0042_m_000002_0
2013-10-31 18:47:24,940 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0042_m_000002_0
2013-10-31 18:47:24,941 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0042_m_000002_0 not found in cache
2013-10-31 18:47:25,282 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0041_m_000000_0' has completed task_20131031182606197_0041_m_000000 successfully.
2013-10-31 18:47:25,541 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0041_m_000001_0' to tip task_20131031182606197_0041_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:25,543 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0041_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:47:25,543 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0041_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,543 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0041_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,701 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0041/attempt_20131031182606197_0041_m_000001_0. Attempting to reuse: jvm_20131031182606197_0041_m_731880323
2013-10-31 18:47:25,871 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0041_m_731880323 given task: attempt_20131031182606197_0041_m_000001_0
2013-10-31 18:47:25,946 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0042_m_000000_0' has completed task_20131031182606197_0042_m_000000 successfully.
2013-10-31 18:47:25,947 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0042_m_000001_0' to tip task_20131031182606197_0042_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:25,948 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0042_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:47:25,948 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0042_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,948 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0042_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,983 INFO  mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0042/attempt_20131031182606197_0042_m_000001_0. Attempting to reuse: jvm_20131031182606197_0042_m_-1590574539
2013-10-31 18:47:25,998 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000001_0 0.0% 
2013-10-31 18:47:26,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary	dst=null	perm=null
2013-10-31 18:47:26,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:26,323 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_SUCCESS from client DFSClient_attempt_20131031182606197_0041_m_000001_0
2013-10-31 18:47:26,323 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0041_m_000001_0
2013-10-31 18:47:26,546 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,547 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,547 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,547 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,547 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,548 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,548 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,548 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,548 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2605274129487483737 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,549 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2605274129487483737 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,549 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2605274129487483737 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,549 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036325246898089699 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,549 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036325246898089699 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,550 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036325246898089699 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041	dst=null	perm=null
2013-10-31 18:47:26,560 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0042_m_-1590574539 given task: attempt_20131031182606197_0042_m_000001_0
2013-10-31 18:47:26,663 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000001_0 0.0% 
2013-10-31 18:47:26,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary	dst=null	perm=null
2013-10-31 18:47:26,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:26,794 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_SUCCESS from client DFSClient_attempt_20131031182606197_0042_m_000001_0
2013-10-31 18:47:26,795 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0042_m_000001_0
2013-10-31 18:47:26,836 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,837 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,837 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,837 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,837 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,838 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,838 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,838 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,838 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5953021751685955983 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,839 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5953021751685955983 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,839 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5953021751685955983 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,839 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-812474416209307718 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,839 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-812474416209307718 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,840 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-812474416209307718 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042	dst=null	perm=null
2013-10-31 18:47:28,621 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_5953021751685955983_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_-2565091071161671132_1412 blk_-812474416209307718_1420 blk_-5014300393221569912_1416
2013-10-31 18:47:28,622 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-8036325246898089699_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_2605274129487483737_1416 blk_-2565091071161671132_1412 blk_-812474416209307718_1420 blk_-5014300393221569912_1416
2013-10-31 18:47:28,940 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000001_0 0.0% cleanup
2013-10-31 18:47:28,942 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0041_m_000001_0 is done.
2013-10-31 18:47:28,942 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0041_m_000001_0  was -1
2013-10-31 18:47:28,942 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:29,329 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data3/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:29,329 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data3/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:29,329 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data3/current/blk_-5014300393221569912
2013-10-31 18:47:29,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-812474416209307718_1420 file build/test/data/dfs/data/data3/current/blk_-812474416209307718 for deletion
2013-10-31 18:47:29,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data3/current/blk_-2565091071161671132
2013-10-31 18:47:29,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data4/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:29,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-812474416209307718_1420 at file build/test/data/dfs/data/data3/current/blk_-812474416209307718
2013-10-31 18:47:29,331 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data4/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:29,331 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data4/current/blk_3499764083074527036
2013-10-31 18:47:29,331 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5953021751685955983_1418 file build/test/data/dfs/data/data4/current/blk_5953021751685955983 for deletion
2013-10-31 18:47:29,331 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data4/current/blk_3570503195496497577
2013-10-31 18:47:29,332 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5953021751685955983_1418 at file build/test/data/dfs/data/data4/current/blk_5953021751685955983
2013-10-31 18:47:29,635 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000001_0 0.0% cleanup
2013-10-31 18:47:29,636 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0042_m_000001_0 is done.
2013-10-31 18:47:29,636 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0042_m_000001_0  was -1
2013-10-31 18:47:29,637 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:30,528 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036325246898089699_1418 file build/test/data/dfs/data/data8/current/blk_-8036325246898089699 for deletion
2013-10-31 18:47:30,528 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data8/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:30,528 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036325246898089699_1418 at file build/test/data/dfs/data/data8/current/blk_-8036325246898089699
2013-10-31 18:47:30,528 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data7/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:30,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data8/current/blk_-5014300393221569912
2013-10-31 18:47:30,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-812474416209307718_1420 file build/test/data/dfs/data/data7/current/blk_-812474416209307718 for deletion
2013-10-31 18:47:30,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data7/current/blk_-2565091071161671132
2013-10-31 18:47:30,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2605274129487483737_1416 file build/test/data/dfs/data/data7/current/blk_2605274129487483737 for deletion
2013-10-31 18:47:30,530 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-812474416209307718_1420 at file build/test/data/dfs/data/data7/current/blk_-812474416209307718
2013-10-31 18:47:30,530 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data7/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:30,530 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2605274129487483737_1416 at file build/test/data/dfs/data/data7/current/blk_2605274129487483737
2013-10-31 18:47:30,530 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data8/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:30,530 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data7/current/blk_3499764083074527036
2013-10-31 18:47:30,531 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data8/current/blk_3570503195496497577
2013-10-31 18:47:31,551 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0041_m_000001_0' has completed task_20131031182606197_0041_m_000001 successfully.
2013-10-31 18:47:31,552 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0041 has completed successfully.
2013-10-31 18:47:31,552 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0041,submitTime=1383245231516,launchTime=1383245231648,firstMapTaskLaunchTime=1383245239269,firstJobSetupTaskLaunchTime=1383245233256,firstJobCleanupTaskLaunchTime=1383245245541,finishTime=1383245251552,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FFFD8058FD054FB8AFF66C79650750C9/2CF6A93BE5C94AF5A38BCEE45A34C4F2] left+right/(3/3) ...dpipesplatform/splitcomp1
2013-10-31 18:47:31,561 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5. blk_-159153927451386666_1429
2013-10-31 18:47:31,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-159153927451386666_1429 src: /127.0.0.1:52164 dest: /127.0.0.1:34578
2013-10-31 18:47:31,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-159153927451386666_1429 src: /127.0.0.1:45362 dest: /127.0.0.1:59471
2013-10-31 18:47:31,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-159153927451386666_1429 src: /127.0.0.1:49537 dest: /127.0.0.1:54365
2013-10-31 18:47:31,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49537, dest: /127.0.0.1:54365, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-159153927451386666_1429, duration: 2709283
2013-10-31 18:47:31,573 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-159153927451386666_1429 terminating
2013-10-31 18:47:31,574 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45362, dest: /127.0.0.1:59471, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-159153927451386666_1429, duration: 3517259
2013-10-31 18:47:31,574 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-159153927451386666_1429 terminating
2013-10-31 18:47:31,575 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-159153927451386666_1429 size 11318
2013-10-31 18:47:31,575 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52164, dest: /127.0.0.1:34578, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-159153927451386666_1429, duration: 4417732
2013-10-31 18:47:31,576 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-159153927451386666_1429 terminating
2013-10-31 18:47:31,581 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-159153927451386666_1429 size 11318
2013-10-31 18:47:31,581 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 from client DFSClient_747896772
2013-10-31 18:47:31,582 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 is closed by DFSClient_747896772
2013-10-31 18:47:31,582 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-159153927451386666_1429 size 11318
2013-10-31 18:47:31,588 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:31,588 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0041_m_000000_0'
2013-10-31 18:47:31,588 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0041_m_000001_0'
2013-10-31 18:47:31,589 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0041_m_000002_0'
2013-10-31 18:47:31,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7668973597655018822 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:31,590 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7668973597655018822 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:31,591 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7668973597655018822 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:31,593 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0041_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:31,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041	dst=null	perm=null
2013-10-31 18:47:31,622 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_5953021751685955983_1418 blk_-8036325246898089699_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_2605274129487483737_1416 blk_-2565091071161671132_1412 blk_-5014300393221569912_1416
2013-10-31 18:47:31,622 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_7668973597655018822_1422
2013-10-31 18:47:31,955 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0042_m_000001_0' has completed task_20131031182606197_0042_m_000001 successfully.
2013-10-31 18:47:31,988 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0042 has completed successfully.
2013-10-31 18:47:31,989 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0042,submitTime=1383245231584,launchTime=1383245232046,firstMapTaskLaunchTime=1383245239938,firstJobSetupTaskLaunchTime=1383245233927,firstJobCleanupTaskLaunchTime=1383245245947,finishTime=1383245251988,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FFFD8058FD054FB8AFF66C79650750C9/B0D9C4DEE0F64FA5A95F1E146F5A59A3] left+right/(2/3) ...dpipesplatform/splitcomp2
2013-10-31 18:47:31,993 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5. blk_-762236133339504791_1429
2013-10-31 18:47:31,996 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-762236133339504791_1429 src: /127.0.0.1:45366 dest: /127.0.0.1:59471
2013-10-31 18:47:32,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-762236133339504791_1429 src: /127.0.0.1:49258 dest: /127.0.0.1:37740
2013-10-31 18:47:32,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-762236133339504791_1429 src: /127.0.0.1:49542 dest: /127.0.0.1:54365
2013-10-31 18:47:32,006 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49542, dest: /127.0.0.1:54365, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-762236133339504791_1429, duration: 339663
2013-10-31 18:47:32,006 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-762236133339504791_1429 terminating
2013-10-31 18:47:32,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49258, dest: /127.0.0.1:37740, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-762236133339504791_1429, duration: 784994
2013-10-31 18:47:32,007 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-762236133339504791_1429 terminating
2013-10-31 18:47:32,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45366, dest: /127.0.0.1:59471, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-762236133339504791_1429, duration: 1848317
2013-10-31 18:47:32,008 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-762236133339504791_1429 terminating
2013-10-31 18:47:32,010 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-762236133339504791_1429 size 11318
2013-10-31 18:47:32,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-762236133339504791_1429 size 11318
2013-10-31 18:47:32,012 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 from client DFSClient_1645291425
2013-10-31 18:47:32,012 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 is closed by DFSClient_1645291425
2013-10-31 18:47:32,012 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-762236133339504791_1429 size 11318
2013-10-31 18:47:32,019 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:32,019 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_92448142914914131 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_92448142914914131 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,020 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0042_m_000000_0'
2013-10-31 18:47:32,020 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_92448142914914131 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:32,020 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0042_m_000001_0'
2013-10-31 18:47:32,020 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0042_m_000002_0'
2013-10-31 18:47:32,020 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0042_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:32,021 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:32,021 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0042 being deleted.
2013-10-31 18:47:32,022 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:32,022 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0041 being deleted.
2013-10-31 18:47:32,022 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:32,022 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0042 being deleted.
2013-10-31 18:47:32,023 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:32,023 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0041 being deleted.
2013-10-31 18:47:32,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042	dst=null	perm=null
2013-10-31 18:47:32,027 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8506542354890884660 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8506542354890884660 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8506542354890884660 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8600798403005839553 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8600798403005839553 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8600798403005839553 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3095433216454494385 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3095433216454494385 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:32,028 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3095433216454494385 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1	dst=null	perm=null
2013-10-31 18:47:32,033 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary
2013-10-31 18:47:32,035 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary
2013-10-31 18:47:32,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1	dst=null	perm=null
2013-10-31 18:47:32,045 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:32,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000	dst=null	perm=null
2013-10-31 18:47:32,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000	dst=null	perm=null
2013-10-31 18:47:32,049 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49543, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7992408142071818202_1426, duration: 289406
2013-10-31 18:47:32,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2	dst=null	perm=null
2013-10-31 18:47:32,058 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:32,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000	dst=null	perm=null
2013-10-31 18:47:32,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000	dst=null	perm=null
2013-10-31 18:47:32,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52173, bytes: 21, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_506252283718536132_1427, duration: 265342
2013-10-31 18:47:32,061 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitcomp2
2013-10-31 18:47:32,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2	dst=null	perm=null
2013-10-31 18:47:32,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000	dst=null	perm=null
2013-10-31 18:47:32,065 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitcomp1
2013-10-31 18:47:32,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49545, bytes: 21, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_506252283718536132_1427, duration: 276104
2013-10-31 18:47:32,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1	dst=null	perm=null
2013-10-31 18:47:32,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000	dst=null	perm=null
2013-10-31 18:47:32,069 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52175, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7992408142071818202_1426, duration: 272977
2013-10-31 18:47:32,077 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:47:32,077 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:47:32,088 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:47:32,089 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  source: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:47:32,089 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup"]
2013-10-31 18:47:32,089 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  parallel execution is enabled: true
2013-10-31 18:47:32,089 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  starting jobs: 1
2013-10-31 18:47:32,089 INFO  flow.Flow (BaseFlow.java:logInfo(1306)) - [test]  allocating threads: 1
2013-10-31 18:47:32,091 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...ldedpipesplatform/nogroup
2013-10-31 18:47:32,094 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:47:32,094 INFO  mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:47:32,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:32,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043	dst=null	perm=hadoop:supergroup:rwx------
2013-10-31 18:47:32,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,113 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar. blk_6803672974736063903_1430
2013-10-31 18:47:32,114 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:49547 dest: /127.0.0.1:54365
2013-10-31 18:47:32,116 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:49265 dest: /127.0.0.1:37740
2013-10-31 18:47:32,117 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:52178 dest: /127.0.0.1:34578
2013-10-31 18:47:32,129 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52178, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6803672974736063903_1430, duration: 8686768
2013-10-31 18:47:32,130 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6803672974736063903_1430 terminating
2013-10-31 18:47:32,130 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49265, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6803672974736063903_1430, duration: 9423868
2013-10-31 18:47:32,131 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6803672974736063903_1430 terminating
2013-10-31 18:47:32,131 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49547, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6803672974736063903_1430, duration: 10561827
2013-10-31 18:47:32,131 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:32,132 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6803672974736063903_1430 terminating
2013-10-31 18:47:32,135 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:32,135 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar from client DFSClient_-1596270109
2013-10-31 18:47:32,136 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:47:32,136 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:32,141 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar. New replication is 10
2013-10-31 18:47:32,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=null
2013-10-31 18:47:32,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,154 INFO  mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:47:32,158 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:32,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:47:32,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,175 INFO  namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split. New replication is 10
2013-10-31 18:47:32,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setReplication	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=null
2013-10-31 18:47:32,183 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split. blk_-2476631661436009888_1431
2013-10-31 18:47:32,184 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:49550 dest: /127.0.0.1:54365
2013-10-31 18:47:32,186 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:52180 dest: /127.0.0.1:34578
2013-10-31 18:47:32,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:45378 dest: /127.0.0.1:59471
2013-10-31 18:47:32,189 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:49270 dest: /127.0.0.1:37740
2013-10-31 18:47:32,192 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49270, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2476631661436009888_1431, duration: 124165
2013-10-31 18:47:32,193 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45378, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2476631661436009888_1431, duration: 969633
2013-10-31 18:47:32,194 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,194 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52180, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2476631661436009888_1431, duration: 1944626
2013-10-31 18:47:32,195 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,195 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49550, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2476631661436009888_1431, duration: 2910350
2013-10-31 18:47:32,196 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,196 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,198 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split from client DFSClient_-1596270109
2013-10-31 18:47:32,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split is closed by DFSClient_-1596270109
2013-10-31 18:47:32,198 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,199 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,220 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo. blk_3823188869741882486_1432
2013-10-31 18:47:32,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3823188869741882486_1432 src: /127.0.0.1:52183 dest: /127.0.0.1:34578
2013-10-31 18:47:32,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3823188869741882486_1432 src: /127.0.0.1:45381 dest: /127.0.0.1:59471
2013-10-31 18:47:32,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3823188869741882486_1432 src: /127.0.0.1:49556 dest: /127.0.0.1:54365
2013-10-31 18:47:32,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49556, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3823188869741882486_1432, duration: 69801
2013-10-31 18:47:32,228 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3823188869741882486_1432 terminating
2013-10-31 18:47:32,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45381, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3823188869741882486_1432, duration: 878974
2013-10-31 18:47:32,229 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3823188869741882486_1432 terminating
2013-10-31 18:47:32,229 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52183, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3823188869741882486_1432, duration: 1714740
2013-10-31 18:47:32,230 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3823188869741882486_1432 terminating
2013-10-31 18:47:32,234 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3823188869741882486_1432 size 156
2013-10-31 18:47:32,234 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3823188869741882486_1432 size 156
2013-10-31 18:47:32,235 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3823188869741882486_1432 size 156
2013-10-31 18:47:32,235 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:47:32,236 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:47:32,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7668973597655018822_1422 file build/test/data/dfs/data/data4/current/blk_7668973597655018822 for deletion
2013-10-31 18:47:32,330 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7668973597655018822_1422 at file build/test/data/dfs/data/data4/current/blk_7668973597655018822
2013-10-31 18:47:32,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=setPermission	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,640 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml. blk_-8952370825653875016_1433
2013-10-31 18:47:32,642 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8952370825653875016_1433 src: /127.0.0.1:49274 dest: /127.0.0.1:37740
2013-10-31 18:47:32,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8952370825653875016_1433 src: /127.0.0.1:45384 dest: /127.0.0.1:59471
2013-10-31 18:47:32,645 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8952370825653875016_1433 src: /127.0.0.1:52188 dest: /127.0.0.1:34578
2013-10-31 18:47:32,649 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52188, dest: /127.0.0.1:34578, bytes: 27340, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8952370825653875016_1433, duration: 892146
2013-10-31 18:47:32,650 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8952370825653875016_1433 terminating
2013-10-31 18:47:32,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45384, dest: /127.0.0.1:59471, bytes: 27340, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8952370825653875016_1433, duration: 1730220
2013-10-31 18:47:32,651 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8952370825653875016_1433 terminating
2013-10-31 18:47:32,651 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8952370825653875016_1433 size 27340
2013-10-31 18:47:32,651 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49274, dest: /127.0.0.1:37740, bytes: 27340, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8952370825653875016_1433, duration: 2734056
2013-10-31 18:47:32,651 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8952370825653875016_1433 size 27340
2013-10-31 18:47:32,651 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8952370825653875016_1433 terminating
2013-10-31 18:47:32,653 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml from client DFSClient_-1596270109
2013-10-31 18:47:32,654 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:47:32,654 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8952370825653875016_1433 size 27340
2013-10-31 18:47:32,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=null
2013-10-31 18:47:32,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45387, bytes: 27556, op: HDFS_READ, cliID: DFSClient_-347020941, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8952370825653875016_1433, duration: 392250
2013-10-31 18:47:32,689 INFO  mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0043: nMaps=4 nReduces=0 max=-1
2013-10-31 18:47:32,689 INFO  mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0043 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:47:32,689 INFO  mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0043
2013-10-31 18:47:32,690 INFO  mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop	IP=127.0.0.1	OPERATION=SUBMIT_JOB	TARGET=job_20131031182606197_0043	RESULT=SUCCESS
2013-10-31 18:47:32,690 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0043
2013-10-31 18:47:32,691 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0043
2013-10-31 18:47:32,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,722 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml. blk_4160337422610249261_1435
2013-10-31 18:47:32,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4160337422610249261_1435 src: /127.0.0.1:49279 dest: /127.0.0.1:37740
2013-10-31 18:47:32,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4160337422610249261_1435 src: /127.0.0.1:52192 dest: /127.0.0.1:34578
2013-10-31 18:47:32,727 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4160337422610249261_1435 src: /127.0.0.1:49564 dest: /127.0.0.1:54365
2013-10-31 18:47:32,731 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49564, dest: /127.0.0.1:54365, bytes: 27405, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4160337422610249261_1435, duration: 795014
2013-10-31 18:47:32,731 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4160337422610249261_1435 terminating
2013-10-31 18:47:32,732 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52192, dest: /127.0.0.1:34578, bytes: 27405, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4160337422610249261_1435, duration: 1613703
2013-10-31 18:47:32,732 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4160337422610249261_1435 terminating
2013-10-31 18:47:32,733 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4160337422610249261_1435 size 27405
2013-10-31 18:47:32,733 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49279, dest: /127.0.0.1:37740, bytes: 27405, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4160337422610249261_1435, duration: 2550728
2013-10-31 18:47:32,734 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4160337422610249261_1435 size 27405
2013-10-31 18:47:32,734 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4160337422610249261_1435 terminating
2013-10-31 18:47:32,736 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml from client DFSClient_-347020941
2013-10-31 18:47:32,736 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml is closed by DFSClient_-347020941
2013-10-31 18:47:32,737 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4160337422610249261_1435 size 27405
2013-10-31 18:47:32,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,749 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken. blk_862287065973210454_1436
2013-10-31 18:47:32,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_862287065973210454_1436 src: /127.0.0.1:49565 dest: /127.0.0.1:54365
2013-10-31 18:47:32,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_862287065973210454_1436 src: /127.0.0.1:45392 dest: /127.0.0.1:59471
2013-10-31 18:47:32,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_862287065973210454_1436 src: /127.0.0.1:49284 dest: /127.0.0.1:37740
2013-10-31 18:47:32,756 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49284, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_862287065973210454_1436, duration: 66329
2013-10-31 18:47:32,757 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_862287065973210454_1436 terminating
2013-10-31 18:47:32,757 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45392, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_862287065973210454_1436, duration: 849895
2013-10-31 18:47:32,758 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_862287065973210454_1436 terminating
2013-10-31 18:47:32,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49565, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_862287065973210454_1436, duration: 1932846
2013-10-31 18:47:32,759 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_862287065973210454_1436 size 116
2013-10-31 18:47:32,759 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_862287065973210454_1436 terminating
2013-10-31 18:47:32,761 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_862287065973210454_1436 size 116
2013-10-31 18:47:32,761 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken from client DFSClient_-1596270109
2013-10-31 18:47:32,762 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:47:32,762 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_862287065973210454_1436 size 116
2013-10-31 18:47:32,767 INFO  mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken
2013-10-31 18:47:32,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo	dst=null	perm=null
2013-10-31 18:47:32,771 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49568, bytes: 160, op: HDFS_READ, cliID: DFSClient_-347020941, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3823188869741882486_1432, duration: 261930
2013-10-31 18:47:32,772 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0043 = 1449. Number of splits = 4
2013-10-31 18:47:32,773 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,773 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,773 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,773 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO  mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,776 INFO  mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0043 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:47:32,776 INFO  mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0043 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:47:33,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036325246898089699_1418 file build/test/data/dfs/data/data5/current/blk_-8036325246898089699 for deletion
2013-10-31 18:47:33,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data6/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:33,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036325246898089699_1418 at file build/test/data/dfs/data/data5/current/blk_-8036325246898089699
2013-10-31 18:47:33,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data5/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:33,059 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data6/current/blk_-5014300393221569912
2013-10-31 18:47:33,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2605274129487483737_1416 file build/test/data/dfs/data/data5/current/blk_2605274129487483737 for deletion
2013-10-31 18:47:33,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data5/current/blk_-2565091071161671132
2013-10-31 18:47:33,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data5/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:33,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2605274129487483737_1416 at file build/test/data/dfs/data/data5/current/blk_2605274129487483737
2013-10-31 18:47:33,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data6/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:33,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data5/current/blk_3499764083074527036
2013-10-31 18:47:33,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5953021751685955983_1418 file build/test/data/dfs/data/data6/current/blk_5953021751685955983 for deletion
2013-10-31 18:47:33,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data6/current/blk_3570503195496497577
2013-10-31 18:47:33,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5953021751685955983_1418 at file build/test/data/dfs/data/data6/current/blk_5953021751685955983
2013-10-31 18:47:34,595 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0043_m_000005_0' to tip task_20131031182606197_0043_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:34,600 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:47:34,601 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000005_0 which needs 1 slots
2013-10-31 18:47:34,601 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000005_0 which needs 1 slots
2013-10-31 18:47:34,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken	dst=null	perm=null
2013-10-31 18:47:34,610 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49290, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_862287065973210454_1436, duration: 290529
2013-10-31 18:47:34,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=null
2013-10-31 18:47:34,620 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49292, bytes: 27556, op: HDFS_READ, cliID: DFSClient_1286514459, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8952370825653875016_1433, duration: 375403
2013-10-31 18:47:34,623 INFO  hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_6803672974736063903_1430 to datanode(s) 127.0.0.1:59471
2013-10-31 18:47:34,624 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_7668973597655018822_1422 blk_-2565091071161671132_1412 blk_-812474416209307718_1420 blk_92448142914914131_1425 blk_3095433216454494385_1410 blk_-8600798403005839553_1408 blk_-5014300393221569912_1416 blk_5953021751685955983_1418 blk_-8036325246898089699_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_2605274129487483737_1416 blk_-8506542354890884660_1411
2013-10-31 18:47:34,624 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_7668973597655018822_1422 blk_3095433216454494385_1410
2013-10-31 18:47:34,648 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:34,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=null
2013-10-31 18:47:34,681 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49576, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1286514459, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6803672974736063903_1430, duration: 1425888
2013-10-31 18:47:34,781 INFO  mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0041_m_-941277400
2013-10-31 18:47:34,788 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9453 with signal TERM. Exit code 0
2013-10-31 18:47:34,789 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-1588713849
2013-10-31 18:47:34,790 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-1588713849 spawned.
2013-10-31 18:47:34,791 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000005_0/taskjvm.sh
2013-10-31 18:47:35,186 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0041_m_-941277400
2013-10-31 18:47:35,818 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:35,818 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:35,818 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:35,818 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0041_m_-941277400 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:36,457 INFO  datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_6803672974736063903_1430 to 127.0.0.1:59471 
2013-10-31 18:47:36,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8600798403005839553_1408 file build/test/data/dfs/data/data2/current/blk_-8600798403005839553 for deletion
2013-10-31 18:47:36,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8506542354890884660_1411 file build/test/data/dfs/data/data1/current/blk_-8506542354890884660 for deletion
2013-10-31 18:47:36,457 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036325246898089699_1418 file build/test/data/dfs/data/data2/current/blk_-8036325246898089699 for deletion
2013-10-31 18:47:36,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8600798403005839553_1408 at file build/test/data/dfs/data/data2/current/blk_-8600798403005839553
2013-10-31 18:47:36,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8506542354890884660_1411 at file build/test/data/dfs/data/data1/current/blk_-8506542354890884660
2013-10-31 18:47:36,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data1/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:36,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036325246898089699_1418 at file build/test/data/dfs/data/data2/current/blk_-8036325246898089699
2013-10-31 18:47:36,459 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data1/current/blk_-5014300393221569912
2013-10-31 18:47:36,459 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:45404 dest: /127.0.0.1:59471
2013-10-31 18:47:36,459 INFO  datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_6803672974736063903_1430 to /127.0.0.1:59471
2013-10-31 18:47:36,458 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data2/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:36,460 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-812474416209307718_1420 file build/test/data/dfs/data/data1/current/blk_-812474416209307718 for deletion
2013-10-31 18:47:36,460 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_92448142914914131_1425 file build/test/data/dfs/data/data2/current/blk_92448142914914131 for deletion
2013-10-31 18:47:36,460 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data2/current/blk_-2565091071161671132
2013-10-31 18:47:36,460 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-812474416209307718_1420 at file build/test/data/dfs/data/data1/current/blk_-812474416209307718
2013-10-31 18:47:36,460 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_92448142914914131_1425 at file build/test/data/dfs/data/data2/current/blk_92448142914914131
2013-10-31 18:47:36,460 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2605274129487483737_1416 file build/test/data/dfs/data/data2/current/blk_2605274129487483737 for deletion
2013-10-31 18:47:36,461 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3095433216454494385_1410 file build/test/data/dfs/data/data2/current/blk_3095433216454494385 for deletion
2013-10-31 18:47:36,461 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2605274129487483737_1416 at file build/test/data/dfs/data/data2/current/blk_2605274129487483737
2013-10-31 18:47:36,461 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data2/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:36,461 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3095433216454494385_1410 at file build/test/data/dfs/data/data2/current/blk_3095433216454494385
2013-10-31 18:47:36,461 INFO  datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6803672974736063903_1430 src: /127.0.0.1:45404 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:47:36,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data2/current/blk_3499764083074527036
2013-10-31 18:47:36,461 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data1/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:36,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5953021751685955983_1418 file build/test/data/dfs/data/data1/current/blk_5953021751685955983 for deletion
2013-10-31 18:47:36,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7668973597655018822_1422 file build/test/data/dfs/data/data1/current/blk_7668973597655018822 for deletion
2013-10-31 18:47:36,462 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data1/current/blk_3570503195496497577
2013-10-31 18:47:36,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5953021751685955983_1418 at file build/test/data/dfs/data/data1/current/blk_5953021751685955983
2013-10-31 18:47:36,463 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7668973597655018822_1422 at file build/test/data/dfs/data/data1/current/blk_7668973597655018822
2013-10-31 18:47:36,466 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:36,488 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-1588713849 given task: attempt_20131031182606197_0043_m_000005_0
2013-10-31 18:47:36,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3095433216454494385_1410 file build/test/data/dfs/data/data8/current/blk_3095433216454494385 for deletion
2013-10-31 18:47:36,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7668973597655018822_1422 file build/test/data/dfs/data/data7/current/blk_7668973597655018822 for deletion
2013-10-31 18:47:36,529 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3095433216454494385_1410 at file build/test/data/dfs/data/data8/current/blk_3095433216454494385
2013-10-31 18:47:36,530 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7668973597655018822_1422 at file build/test/data/dfs/data/data7/current/blk_7668973597655018822
2013-10-31 18:47:36,590 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:36,591 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0041_m_000000_0 not found in cache
2013-10-31 18:47:36,591 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0041_m_000001_0 not found in cache
2013-10-31 18:47:36,591 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383331656591
2013-10-31 18:47:36,591 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:36,591 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0042 being deleted.
2013-10-31 18:47:36,980 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0041_m_731880323 since job job_20131031182606197_0041 is dead
2013-10-31 18:47:36,987 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9668 with signal TERM. Exit code 0
2013-10-31 18:47:37,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:37,021 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:37,021 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0042_m_000000_0 not found in cache
2013-10-31 18:47:37,021 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0042_m_000001_0 not found in cache
2013-10-31 18:47:37,022 INFO  mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383331657021
2013-10-31 18:47:37,022 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:37,022 WARN  mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0041 being deleted.
2013-10-31 18:47:37,139 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:37,139 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:37,139 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:37,139 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0041_m_731880323 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:47:37,625 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_92448142914914131_1425 blk_-8506542354890884660_1411 blk_3095433216454494385_1410 blk_-8600798403005839553_1408
2013-10-31 18:47:37,625 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_92448142914914131_1425 blk_-8506542354890884660_1411 blk_-8600798403005839553_1408
2013-10-31 18:47:37,675 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0042_m_-1590574539 since job job_20131031182606197_0042 is dead
2013-10-31 18:47:37,685 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9510 with signal TERM. Exit code 0
2013-10-31 18:47:37,896 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:37,896 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:37,896 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:37,896 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0042_m_-1590574539 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:47:38,302 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0042_m_-1110644511 since job job_20131031182606197_0042 is dead
2013-10-31 18:47:38,312 INFO  util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9707 with signal TERM. Exit code 0
2013-10-31 18:47:38,332 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8600798403005839553_1408 file build/test/data/dfs/data/data3/current/blk_-8600798403005839553 for deletion
2013-10-31 18:47:38,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8506542354890884660_1411 file build/test/data/dfs/data/data3/current/blk_-8506542354890884660 for deletion
2013-10-31 18:47:38,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8600798403005839553_1408 at file build/test/data/dfs/data/data3/current/blk_-8600798403005839553
2013-10-31 18:47:38,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_92448142914914131_1425 file build/test/data/dfs/data/data4/current/blk_92448142914914131 for deletion
2013-10-31 18:47:38,333 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8506542354890884660_1411 at file build/test/data/dfs/data/data3/current/blk_-8506542354890884660
2013-10-31 18:47:38,334 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3095433216454494385_1410 file build/test/data/dfs/data/data4/current/blk_3095433216454494385 for deletion
2013-10-31 18:47:38,334 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_92448142914914131_1425 at file build/test/data/dfs/data/data4/current/blk_92448142914914131
2013-10-31 18:47:38,335 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3095433216454494385_1410 at file build/test/data/dfs/data/data4/current/blk_3095433216454494385
2013-10-31 18:47:38,496 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_8597259860310358460_1102
2013-10-31 18:47:38,497 WARN  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:38,497 INFO  mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:38,497 INFO  mapred.TaskController (TaskController.java:logOutput(249)) - 
2013-10-31 18:47:38,497 INFO  mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0042_m_-1110644511 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:39,060 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8600798403005839553_1408 file build/test/data/dfs/data/data6/current/blk_-8600798403005839553 for deletion
2013-10-31 18:47:39,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8506542354890884660_1411 file build/test/data/dfs/data/data6/current/blk_-8506542354890884660 for deletion
2013-10-31 18:47:39,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8600798403005839553_1408 at file build/test/data/dfs/data/data6/current/blk_-8600798403005839553
2013-10-31 18:47:39,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_92448142914914131_1425 file build/test/data/dfs/data/data6/current/blk_92448142914914131 for deletion
2013-10-31 18:47:39,061 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8506542354890884660_1411 at file build/test/data/dfs/data/data6/current/blk_-8506542354890884660
2013-10-31 18:47:39,062 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_92448142914914131_1425 at file build/test/data/dfs/data/data6/current/blk_92448142914914131
2013-10-31 18:47:39,928 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000005_0 0.0% setup
2013-10-31 18:47:39,930 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000005_0 is done.
2013-10-31 18:47:39,930 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000005_0  was -1
2013-10-31 18:47:39,931 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:40,608 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000005_0' has completed task_20131031182606197_0043_m_000005 successfully.
2013-10-31 18:47:40,613 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000000_0' to tip task_20131031182606197_0043_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:40,614 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000000
2013-10-31 18:47:40,616 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:47:40,616 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000000_0 which needs 1 slots
2013-10-31 18:47:40,616 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000000_0 which needs 1 slots
2013-10-31 18:47:40,646 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_1376735318
2013-10-31 18:47:40,647 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_1376735318 spawned.
2013-10-31 18:47:40,648 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000000_0/taskjvm.sh
2013-10-31 18:47:41,030 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000001_0' to tip task_20131031182606197_0043_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:41,031 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000001
2013-10-31 18:47:41,032 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:47:41,032 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000001_0 which needs 1 slots
2013-10-31 18:47:41,032 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000002_0' to tip task_20131031182606197_0043_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:47:41,032 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000001_0 which needs 1 slots
2013-10-31 18:47:41,032 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000002
2013-10-31 18:47:41,033 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000003_0' to tip task_20131031182606197_0043_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:47:41,033 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:47:41,034 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000002_0 which needs 1 slots
2013-10-31 18:47:41,034 INFO  mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000003
2013-10-31 18:47:41,034 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000002_0 which needs 1 slots
2013-10-31 18:47:41,035 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:47:41,035 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000003_0 which needs 1 slots
2013-10-31 18:47:41,035 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000003_0 which needs 1 slots
2013-10-31 18:47:41,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken	dst=null	perm=null
2013-10-31 18:47:41,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken	dst=null	perm=null
2013-10-31 18:47:41,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken	dst=null	perm=null
2013-10-31 18:47:41,038 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49580, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_862287065973210454_1436, duration: 144205
2013-10-31 18:47:41,038 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49581, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_862287065973210454_1436, duration: 128082
2013-10-31 18:47:41,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=null
2013-10-31 18:47:41,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=null
2013-10-31 18:47:41,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52213, bytes: 27556, op: HDFS_READ, cliID: DFSClient_-1538069192, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8952370825653875016_1433, duration: 153316
2013-10-31 18:47:41,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49302, bytes: 27556, op: HDFS_READ, cliID: DFSClient_826029349, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8952370825653875016_1433, duration: 148967
2013-10-31 18:47:41,061 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:41,061 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:41,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=null
2013-10-31 18:47:41,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=null
2013-10-31 18:47:41,076 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49304, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_862287065973210454_1436, duration: 134456
2013-10-31 18:47:41,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49305, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1538069192, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6803672974736063903_1430, duration: 626655
2013-10-31 18:47:41,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49303, bytes: 239915, op: HDFS_READ, cliID: DFSClient_826029349, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6803672974736063903_1430, duration: 640530
2013-10-31 18:47:41,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml	dst=null	perm=null
2013-10-31 18:47:41,081 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52219, bytes: 27556, op: HDFS_READ, cliID: DFSClient_-426393825, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8952370825653875016_1433, duration: 153457
2013-10-31 18:47:41,093 INFO  mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:41,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar	dst=null	perm=null
2013-10-31 18:47:41,108 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52220, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-426393825, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6803672974736063903_1430, duration: 608406
2013-10-31 18:47:41,132 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-231425040
2013-10-31 18:47:41,132 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_157840219
2013-10-31 18:47:41,133 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-231425040 spawned.
2013-10-31 18:47:41,133 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_157840219 spawned.
2013-10-31 18:47:41,135 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000001_0/taskjvm.sh
2013-10-31 18:47:41,135 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000002_0/taskjvm.sh
2013-10-31 18:47:41,511 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_1376735318 given task: attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:42,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=null
2013-10-31 18:47:42,039 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49594, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2476631661436009888_1431, duration: 360156
2013-10-31 18:47:42,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:47:42,080 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49312, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 250627
2013-10-31 18:47:42,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:42,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:42,773 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-1910409010
2013-10-31 18:47:42,774 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-1910409010 spawned.
2013-10-31 18:47:42,777 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000003_0/taskjvm.sh
2013-10-31 18:47:42,985 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000. blk_-8962913433765712905_1437
2013-10-31 18:47:43,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8962913433765712905_1437 src: /127.0.0.1:45422 dest: /127.0.0.1:59471
2013-10-31 18:47:43,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8962913433765712905_1437 src: /127.0.0.1:52226 dest: /127.0.0.1:34578
2013-10-31 18:47:43,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8962913433765712905_1437 src: /127.0.0.1:49315 dest: /127.0.0.1:37740
2013-10-31 18:47:43,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49315, dest: /127.0.0.1:37740, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8962913433765712905_1437, duration: 1212939
2013-10-31 18:47:43,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8962913433765712905_1437 terminating
2013-10-31 18:47:43,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52226, dest: /127.0.0.1:34578, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8962913433765712905_1437, duration: 1542247
2013-10-31 18:47:43,013 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8962913433765712905_1437 terminating
2013-10-31 18:47:43,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45422, dest: /127.0.0.1:59471, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8962913433765712905_1437, duration: 2038627
2013-10-31 18:47:43,014 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8962913433765712905_1437 terminating
2013-10-31 18:47:43,015 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8962913433765712905_1437 size 30
2013-10-31 18:47:43,015 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:43,015 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:43,015 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8962913433765712905_1437 size 30
2013-10-31 18:47:43,018 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8962913433765712905_1437 size 30
2013-10-31 18:47:43,065 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:43,065 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000000_0 0.0% 
2013-10-31 18:47:43,577 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_157840219 given task: attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:43,617 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:43,649 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-1910409010 given task: attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:43,654 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-231425040 given task: attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:43,851 INFO  datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-1869663385596486972_1008
2013-10-31 18:47:44,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=null
2013-10-31 18:47:44,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0	dst=null	perm=null
2013-10-31 18:47:44,072 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45431, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2476631661436009888_1431, duration: 195264
2013-10-31 18:47:44,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:44,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:44,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0	dst=null	perm=null
2013-10-31 18:47:44,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:47:44,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=null
2013-10-31 18:47:44,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split	dst=null	perm=null
2013-10-31 18:47:44,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49606, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2476631661436009888_1431, duration: 161682
2013-10-31 18:47:44,151 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49324, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2476631661436009888_1431, duration: 102916
2013-10-31 18:47:44,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:47:44,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt	dst=null	perm=null
2013-10-31 18:47:44,287 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52237, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 386604
2013-10-31 18:47:44,288 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49326, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 392164
2013-10-31 18:47:44,955 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:47:44,957 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000000_0 is done.
2013-10-31 18:47:44,957 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000000_0  was -1
2013-10-31 18:47:44,957 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:45,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:45,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:45,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:45,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:45,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:45,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:45,616 INFO  mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0043_m_000005_0
2013-10-31 18:47:45,617 INFO  mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0043_m_000005_0
2013-10-31 18:47:45,617 INFO  mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0043_m_000005_0 not found in cache
2013-10-31 18:47:45,776 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49328, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 391385
2013-10-31 18:47:45,781 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003. blk_-6467763038331022052_1440
2013-10-31 18:47:45,782 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001. blk_-8432574215463755477_1440
2013-10-31 18:47:45,803 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002. blk_5508101355172456519_1440
2013-10-31 18:47:45,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6467763038331022052_1440 src: /127.0.0.1:49612 dest: /127.0.0.1:54365
2013-10-31 18:47:45,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6467763038331022052_1440 src: /127.0.0.1:52244 dest: /127.0.0.1:34578
2013-10-31 18:47:45,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8432574215463755477_1440 src: /127.0.0.1:45439 dest: /127.0.0.1:59471
2013-10-31 18:47:45,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8432574215463755477_1440 src: /127.0.0.1:49334 dest: /127.0.0.1:37740
2013-10-31 18:47:45,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6467763038331022052_1440 src: /127.0.0.1:45442 dest: /127.0.0.1:59471
2013-10-31 18:47:45,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8432574215463755477_1440 src: /127.0.0.1:49618 dest: /127.0.0.1:54365
2013-10-31 18:47:45,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45442, dest: /127.0.0.1:59471, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6467763038331022052_1440, duration: 1565862
2013-10-31 18:47:45,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49618, dest: /127.0.0.1:54365, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8432574215463755477_1440, duration: 320344
2013-10-31 18:47:45,811 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6467763038331022052_1440 terminating
2013-10-31 18:47:45,811 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8432574215463755477_1440 terminating
2013-10-31 18:47:45,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52244, dest: /127.0.0.1:34578, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6467763038331022052_1440, duration: 869820
2013-10-31 18:47:45,811 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8432574215463755477_1440 size 41
2013-10-31 18:47:45,812 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6467763038331022052_1440 terminating
2013-10-31 18:47:45,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49334, dest: /127.0.0.1:37740, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8432574215463755477_1440, duration: 738917
2013-10-31 18:47:45,812 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49612, dest: /127.0.0.1:54365, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6467763038331022052_1440, duration: 2704758
2013-10-31 18:47:45,812 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6467763038331022052_1440 size 29
2013-10-31 18:47:45,812 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8432574215463755477_1440 terminating
2013-10-31 18:47:45,812 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6467763038331022052_1440 terminating
2013-10-31 18:47:45,813 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:45,814 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:45,815 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6467763038331022052_1440 size 29
2013-10-31 18:47:45,815 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45439, dest: /127.0.0.1:59471, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8432574215463755477_1440, duration: 1686689
2013-10-31 18:47:45,815 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8432574215463755477_1440 terminating
2013-10-31 18:47:45,815 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6467763038331022052_1440 size 29
2013-10-31 18:47:45,817 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8432574215463755477_1440 size 41
2013-10-31 18:47:45,817 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:45,818 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:45,818 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8432574215463755477_1440 size 41
2013-10-31 18:47:45,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5508101355172456519_1440 src: /127.0.0.1:45440 dest: /127.0.0.1:59471
2013-10-31 18:47:45,830 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5508101355172456519_1440 src: /127.0.0.1:52248 dest: /127.0.0.1:34578
2013-10-31 18:47:45,831 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5508101355172456519_1440 src: /127.0.0.1:49620 dest: /127.0.0.1:54365
2013-10-31 18:47:45,833 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49620, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5508101355172456519_1440, duration: 1786459
2013-10-31 18:47:45,833 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5508101355172456519_1440 terminating
2013-10-31 18:47:45,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52248, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 2068437
2013-10-31 18:47:45,834 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5508101355172456519_1440 terminating
2013-10-31 18:47:45,834 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5508101355172456519_1440 size 40
2013-10-31 18:47:45,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45440, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5508101355172456519_1440, duration: 2449682
2013-10-31 18:47:45,834 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5508101355172456519_1440 terminating
2013-10-31 18:47:45,836 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:45,836 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:45,836 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5508101355172456519_1440 size 40
2013-10-31 18:47:45,838 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5508101355172456519_1440 size 40
2013-10-31 18:47:45,862 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:45,862 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000003_0 0.0% 
2013-10-31 18:47:45,865 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:45,865 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000001_0 0.0% 
2013-10-31 18:47:45,885 INFO  mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:45,885 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000002_0 0.0% 
2013-10-31 18:47:46,621 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000000_0' has completed task_20131031182606197_0043_m_000000 successfully.
2013-10-31 18:47:47,036 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:47,038 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:47,039 INFO  mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:47,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0	dst=null	perm=null
2013-10-31 18:47:47,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0	dst=null	perm=null
2013-10-31 18:47:47,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:47,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:47,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:47,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:47,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0	dst=null	perm=null
2013-10-31 18:47:47,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=mkdirs	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:47,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0	dst=null	perm=null
2013-10-31 18:47:47,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0	dst=null	perm=null
2013-10-31 18:47:47,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=rename	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002	dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:47,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0	dst=null	perm=null
2013-10-31 18:47:50,042 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:47:50,044 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:47:50,045 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000001_0 is done.
2013-10-31 18:47:50,045 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000001_0  was -1
2013-10-31 18:47:50,046 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:50,120 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:47:50,120 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:47:50,123 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:47:50,124 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000002_0 is done.
2013-10-31 18:47:50,124 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:47:50,124 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000002_0  was -1
2013-10-31 18:47:50,125 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:50,126 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000003_0 is done.
2013-10-31 18:47:50,126 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000003_0  was -1
2013-10-31 18:47:50,126 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:53,041 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000001_0' has completed task_20131031182606197_0043_m_000001 successfully.
2013-10-31 18:47:53,045 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000002_0' has completed task_20131031182606197_0043_m_000002 successfully.
2013-10-31 18:47:53,048 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000003_0' has completed task_20131031182606197_0043_m_000003 successfully.
2013-10-31 18:47:53,050 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0043_m_000004_0' to tip task_20131031182606197_0043_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:47:53,053 INFO  mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:47:53,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000004_0 which needs 1 slots
2013-10-31 18:47:53,053 INFO  mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000004_0 which needs 1 slots
2013-10-31 18:47:53,085 INFO  mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-1715929147
2013-10-31 18:47:53,086 INFO  mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-1715929147 spawned.
2013-10-31 18:47:53,088 INFO  mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000004_0/taskjvm.sh
2013-10-31 18:47:53,955 INFO  mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-1715929147 given task: attempt_20131031182606197_0043_m_000004_0
2013-10-31 18:47:54,485 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000004_0 0.0% 
2013-10-31 18:47:54,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary	dst=null	perm=null
2013-10-31 18:47:54,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=create	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_SUCCESS	dst=null	perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:54,600 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_SUCCESS from client DFSClient_attempt_20131031182606197_0043_m_000004_0
2013-10-31 18:47:54,600 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0043_m_000004_0
2013-10-31 18:47:54,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:54,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:54,613 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:54,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:54,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,614 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3823188869741882486 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:54,615 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3823188869741882486 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,615 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3823188869741882486 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,615 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8952370825653875016 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,615 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8952370825653875016 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:54,616 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8952370825653875016 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043	dst=null	perm=null
2013-10-31 18:47:55,628 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete  blk_-8952370825653875016_1433 blk_3823188869741882486_1432 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:55,629 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete  blk_-8952370825653875016_1433 blk_3823188869741882486_1432 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:56,008 INFO  metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:47:56,019 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,025 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,030 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,041 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,046 INFO  metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:47:57,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8952370825653875016_1433 file build/test/data/dfs/data/data6/current/blk_-8952370825653875016 for deletion
2013-10-31 18:47:57,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2476631661436009888_1431 file build/test/data/dfs/data/data6/current/blk_-2476631661436009888 for deletion
2013-10-31 18:47:57,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8952370825653875016_1433 at file build/test/data/dfs/data/data6/current/blk_-8952370825653875016
2013-10-31 18:47:57,067 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3823188869741882486_1432 file build/test/data/dfs/data/data5/current/blk_3823188869741882486 for deletion
2013-10-31 18:47:57,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2476631661436009888_1431 at file build/test/data/dfs/data/data6/current/blk_-2476631661436009888
2013-10-31 18:47:57,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6803672974736063903_1430 file build/test/data/dfs/data/data6/current/blk_6803672974736063903 for deletion
2013-10-31 18:47:57,068 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3823188869741882486_1432 at file build/test/data/dfs/data/data5/current/blk_3823188869741882486
2013-10-31 18:47:57,069 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6803672974736063903_1430 at file build/test/data/dfs/data/data6/current/blk_6803672974736063903
2013-10-31 18:47:57,397 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000004_0 0.0% cleanup
2013-10-31 18:47:57,398 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000004_0 is done.
2013-10-31 18:47:57,398 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000004_0  was -1
2013-10-31 18:47:57,399 INFO  mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:57,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8952370825653875016_1433 file build/test/data/dfs/data/data1/current/blk_-8952370825653875016 for deletion
2013-10-31 18:47:57,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2476631661436009888_1431 file build/test/data/dfs/data/data1/current/blk_-2476631661436009888 for deletion
2013-10-31 18:47:57,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8952370825653875016_1433 at file build/test/data/dfs/data/data1/current/blk_-8952370825653875016
2013-10-31 18:47:57,464 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3823188869741882486_1432 file build/test/data/dfs/data/data2/current/blk_3823188869741882486 for deletion
2013-10-31 18:47:57,465 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2476631661436009888_1431 at file build/test/data/dfs/data/data1/current/blk_-2476631661436009888
2013-10-31 18:47:57,465 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6803672974736063903_1430 file build/test/data/dfs/data/data2/current/blk_6803672974736063903 for deletion
2013-10-31 18:47:57,465 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3823188869741882486_1432 at file build/test/data/dfs/data/data2/current/blk_3823188869741882486
2013-10-31 18:47:57,466 INFO  datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6803672974736063903_1430 at file build/test/data/dfs/data/data2/current/blk_6803672974736063903
2013-10-31 18:47:58,629 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete  blk_-8952370825653875016_1433 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:58,629 INFO  hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete  blk_3823188869741882486_1432 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:59,059 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000004_0' has completed task_20131031182606197_0043_m_000004 successfully.
2013-10-31 18:47:59,060 INFO  mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0043 has completed successfully.
2013-10-31 18:47:59,060 INFO  mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0043,submitTime=1383245252661,launchTime=1383245252776,firstMapTaskLaunchTime=1383245260613,firstJobSetupTaskLaunchTime=1383245254594,firstJobCleanupTaskLaunchTime=1383245273050,finishTime=1383245279060,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E00F2344117143A5B429E5EE528AF580/3B12F52DDD1C48908457498CADDDFFE9] test/(1/1) ...ldedpipesplatform/nogroup
2013-10-31 18:47:59,065 INFO  hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890. blk_9068118107613675848_1441
2013-10-31 18:47:59,067 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9068118107613675848_1441 src: /127.0.0.1:52254 dest: /127.0.0.1:34578
2013-10-31 18:47:59,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9068118107613675848_1441 src: /127.0.0.1:49626 dest: /127.0.0.1:54365
2013-10-31 18:47:59,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9068118107613675848_1441 src: /127.0.0.1:45453 dest: /127.0.0.1:59471
2013-10-31 18:47:59,081 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45453, dest: /127.0.0.1:59471, bytes: 22671, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9068118107613675848_1441, duration: 6136296
2013-10-31 18:47:59,082 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9068118107613675848_1441 terminating
2013-10-31 18:47:59,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49626, dest: /127.0.0.1:54365, bytes: 22671, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9068118107613675848_1441, duration: 4059705
2013-10-31 18:47:59,083 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9068118107613675848_1441 terminating
2013-10-31 18:47:59,083 INFO  DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52254, dest: /127.0.0.1:34578, bytes: 22671, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9068118107613675848_1441, duration: 5097593
2013-10-31 18:47:59,084 INFO  datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9068118107613675848_1441 terminating
2013-10-31 18:47:59,086 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9068118107613675848_1441 size 22671
2013-10-31 18:47:59,087 INFO  hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on  file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 from client DFSClient_-347020941
2013-10-31 18:47:59,087 INFO  hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 is closed by DFSClient_-347020941
2013-10-31 18:47:59,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9068118107613675848_1441 size 22671
2013-10-31 18:47:59,088 INFO  hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9068118107613675848_1441 size 22671
2013-10-31 18:47:59,095 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:59,096 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0043_m_000003_0'
2013-10-31 18:47:59,096 INFO  mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0043_m_000004_0'
2013-10-31 18:47:59,098 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_862287065973210454 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:59,104 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_862287065973210454 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:59,104 INFO  hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_862287065973210454 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:59,106 INFO  mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0043_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:59,109 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary
2013-10-31 18:47:59,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=delete	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043	dst=null	perm=null
2013-10-31 18:47:59,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=null
2013-10-31 18:47:59,166 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:47:59,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000	dst=null	perm=null
2013-10-31 18:47:59,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001	dst=null	perm=null
2013-10-31 18:47:59,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002	dst=null	perm=null
2013-10-31 18:47:59,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003	dst=null	perm=null
2013-10-31 18:47:59,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000	dst=null	perm=null
2013-10-31 18:47:59,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49346, bytes: 34, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8962913433765712905_1437, duration: 291097
2013-10-31 18:47:59,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001	dst=null	perm=null
2013-10-31 18:47:59,179 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49347, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8432574215463755477_1440, duration: 337566
2013-10-31 18:47:59,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002	dst=null	perm=null
2013-10-31 18:47:59,182 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52260, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 260387
2013-10-31 18:47:59,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003	dst=null	perm=null
2013-10-31 18:47:59,185 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49632, bytes: 33, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6467763038331022052_1440, duration: 266893
2013-10-31 18:47:59,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=null
2013-10-31 18:47:59,202 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:47:59,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000	dst=null	perm=null
2013-10-31 18:47:59,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001	dst=null	perm=null
2013-10-31 18:47:59,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002	dst=null	perm=null
2013-10-31 18:47:59,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003	dst=null	perm=null
2013-10-31 18:47:59,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000	dst=null	perm=null
2013-10-31 18:47:59,211 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52262, bytes: 34, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8962913433765712905_1437, duration: 253654
2013-10-31 18:47:59,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001	dst=null	perm=null
2013-10-31 18:47:59,214 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49351, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8432574215463755477_1440, duration: 252321
2013-10-31 18:47:59,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002	dst=null	perm=null
2013-10-31 18:47:59,217 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52264, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 253306
2013-10-31 18:47:59,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003	dst=null	perm=null
2013-10-31 18:47:59,221 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45462, bytes: 33, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6467763038331022052_1440, duration: 259338
2013-10-31 18:47:59,221 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/nogroup
2013-10-31 18:47:59,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=listStatus	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup	dst=null	perm=null
2013-10-31 18:47:59,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000	dst=null	perm=null
2013-10-31 18:47:59,229 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49354, bytes: 34, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8962913433765712905_1437, duration: 263431
2013-10-31 18:47:59,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001	dst=null	perm=null
2013-10-31 18:47:59,233 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49638, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8432574215463755477_1440, duration: 263778
2013-10-31 18:47:59,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002	dst=null	perm=null
2013-10-31 18:47:59,238 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52268, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 284093
2013-10-31 18:47:59,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop	ip=/127.0.0.1	cmd=open	src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003	dst=null	perm=null
2013-10-31 18:47:59,242 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49640, bytes: 33, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6467763038331022052_1440, duration: 258787